What is Scaling laws?Scaling laws kya hai?

🧸 Think of it likeAise samjho

Like knowing that more practice hours and better coaching improve a runner's time in a predictable way.Jaise pata hona ki zyada practice ghante aur behtar coaching runner ka time ek tay andaaz mein sudhaarte hain.

📘 ExplainedVistaar se

Research found that loss falls smoothly as a power law with more parameters, training tokens and compute, and that model size and data should grow together for the best use of compute. These laws guide how big labs plan training runs.Research mein paaya gaya ki zyaada parameters, training tokens aur compute ke saath loss power law ki tarah smoothly girta hai, aur compute ka best use karne ke liye model size aur data saath badhne chahiye. Yeh laws bade labs ko training runs plan karne mein guide karte hain.

💡 Real exampleAsli example

Doubling training data and model size together gives a predictable drop in loss.Training data aur model size dono double karne pe loss mein anumaanit girawat.

📖 Learn it step by stepStep by step seekho

• Reading and reproducing research papersResearch papers padhna aur reproduce karna

🔗 Related termsJude hue shabd

• ParameterA number inside a model that is learned during training; LLMs have billions of them.Model ke andar ka number jo training mein seekha jaata hai; LLMs mein arabon hote hain.
• Foundation modelA large model trained on broad data that can be adapted to many tasks.Bade aur vyapak data pe train hua bada model jise kai kaamon ke liye adapt kiya ja sakta hai.