What is Batch size?Batch size kya hai?

🧸 Think of it likeAise samjho

Like a teacher correcting 32 copies, then giving the class one round of feedback, instead of giving feedback after every single copy.Jaise teacher 32 copies check karke class ko ek baar feedback deta hai, har ek copy ke baad feedback dene ki jagah.

📘 ExplainedVistaar se

Training updates weights after each mini batch rather than after every example or the whole dataset. Larger batches use the GPU efficiently but need more memory; smaller batches are noisier but can generalise well. In LLM serving, batching many user requests together raises throughput and lowers cost per request.Training har example ya poore dataset ke baad nahi, har mini batch ke baad weights update karti hai. Bade batches GPU ka accha use karte hain par zyaada memory chahiye; chhote batches mein zyaada noise hota hai par generalise acche se kar sakte hain. LLM serving mein bahut saari user requests saath batch karne se throughput badhta aur per request cost ghatta hai.

💡 Real exampleAsli example

Training with batch size 32 means the model looks at 32 images before each weight update.Batch size 32 se training matlab model har weight update se pehle 32 images dekhta hai.

📖 Learn it step by stepStep by step seekho

• Gradients and gradient descent: how models improveGradients aur gradient descent: models behtar kaise hote hain
• Serving LLMs efficiently: GPUs, batching and costLLMs ko efficiently serve karna: GPUs, batching aur cost

🔗 Related termsJude hue shabd

• EpochOne full pass of the training algorithm over the entire training dataset.Training algorithm ka poore training dataset pe ek poora chakkar.
• Gradient descentThe training method that repeatedly adjusts weights in small steps to reduce error.Training ka tarika jo error kam karne ke liye weights ko baar baar chhote kadmon mein badalta hai.
• GPUA chip that does thousands of maths operations in parallel, which makes training and running AI fast.Chip jo hazaaron maths operations ek saath karta hai, jisse AI ki training aur chalaana tez hota hai.