AI dictionary · Deep learning

What is Learning rate?Learning rate kya hai?

Learning rate: How big a step the model takes when updating its weights during training.Training mein weights update karte waqt model kitna bada kadam leta hai.

🧸 Think of it likeAise samjho

Like the size of your steps when looking for something in the dark: too big and you keep overshooting, too small and it takes forever.Andhere mein kuch dhoondhte waqt kadmon ke size jaisa: bahut bade toh aage nikal jaate ho, bahut chhote toh bahut der lagti hai.

📘 ExplainedVistaar se

Too high and training jumps around or diverges; too low and it's painfully slow or gets stuck. Schedules (warm up, then decay) and optimisers like Adam help. It's usually the most important hyperparameter to tune.Bahut zyaada to training uchhalti ya bigad jaati hai; bahut kam to bahut slow ya atak jaati hai. Schedules (warm up, phir decay) aur Adam jaise optimisers madad karte hain. Aam taur pe tune karne ka sabse zaroori hyperparameter yahi hai.

💡 Real exampleAsli example

Loss bouncing up and down usually means the learning rate is too high.Loss ka upar neeche uchhalna aksar matlab learning rate bahut zyaada hai.

📖 Learn it step by stepStep by step seekho

🔗 Related termsJude hue shabd

Questions people ask

What is Learning rate?

How big a step the model takes when updating its weights during training. Too high and training jumps around or diverges; too low and it's painfully slow or gets stuck. Schedules (warm up, then decay) and optimisers like Adam help. It's usually the most important hyperparameter to tune.

How can I understand Learning rate in simple words?

Like the size of your steps when looking for something in the dark: too big and you keep overshooting, too small and it takes forever.

What is an example of Learning rate?

Loss bouncing up and down usually means the learning rate is too high.

Learning rate ka matlab kya hai?

Training mein weights update karte waqt model kitna bada kadam leta hai. Andhere mein kuch dhoondhte waqt kadmon ke size jaisa: bahut bade toh aage nikal jaate ho, bahut chhote toh bahut der lagti hai.

See Learning rate in the full A to Z dictionary · Start a free AI course