What is Softmax?Softmax kya hai?

🧸 Think of it likeAise samjho

Like turning cricket match scores into win chances that add up to 100%.Cricket match ke scores ko jeet ke chances mein badalna jo milkar 100% hote hain.

📘 ExplainedVistaar se

Softmax exponentiates each score and divides by the total, so bigger scores get most of the probability. It's used in classification outputs, in attention weights, and when an LLM picks the next token; temperature reshapes it.Softmax har score ka exponential leta hai aur total se divide karta hai, isliye bade scores ko zyaadatar probability milti hai. Yeh classification outputs, attention weights, aur LLM ke agla token chunne mein use hota hai; temperature ise reshape karta hai.

💡 Real exampleAsli example

Scores 2, 1, 0 become probabilities of about 0.67, 0.24 and 0.09.Scores 2, 1, 0 lagbhag 0.67, 0.24 aur 0.09 probabilities ban jaate hain.

📖 Learn it step by stepStep by step seekho

• Neural networks: layers that learnNeural networks: layers jo seekhti hain
• Transformers and attention: how LLMs readTransformers aur attention: LLMs kaise padhte hain

🔗 Related termsJude hue shabd

• Cross entropyThe standard loss function for classification: it punishes confident wrong answers heavily.Classification ka standard loss function: confident galat jawaabon ko bhaari saza deta hai.
• TemperatureA setting that controls how random or creative an LLM's word choices are.Setting jo tay karti hai LLM ke shabdon ka chunaav kitna random ya creative ho.
• AttentionThe mechanism in transformers that lets each word look at every other word to understand its meaning in context.Transformers ka woh mechanism jisse har shabd baaki har shabd ko dekhkar context mein apna matlab samajhta hai.