What is Inference?Inference kya hai?

🧸 Think of it likeAise samjho

Training is studying; inference is sitting the exam: using what was learned to answer a new question.Training padhai hai; inference exam dena hai: jo seekha use naye sawaal ka jawaab dene mein use karna.

📘 ExplainedVistaar se

Training happens occasionally; inference happens every time a user needs a prediction or an LLM answer. Inference must be fast, reliable and affordable, so it involves APIs, autoscaling, batching, caching and monitoring. For most companies inference is the main ongoing AI cost.Training kabhi kabhi hoti hai; inference har baar hota hai jab user ko prediction ya LLM jawaab chahiye. Inference tez, reliable aur sasta hona chahiye, isliye isme APIs, autoscaling, batching, caching aur monitoring aate hain. Zyaadatar companies ke liye inference hi AI ka main chalta kharch hai.

💡 Real exampleAsli example

Each time you ask a chatbot a question, the model runs inference.Har baar chatbot se sawaal poochhne pe model inference chalata hai.

📖 Learn it step by stepStep by step seekho

• Training vs inference: how ML runs in productionTraining vs inference: ML production mein kaise chalta hai
• Serving LLMs efficiently: GPUs, batching and costLLMs ko efficiently serve karna: GPUs, batching aur cost

🔗 Related termsJude hue shabd

• TrainingThe process where a model learns its parameters from data.Woh process jisme model data se apne parameters seekhta hai.
• LatencyHow long a request takes from asking to getting the answer.Request bhejne se jawaab milne tak kitna time lagta hai.
• Batch inferenceRunning a model on many records at once on a schedule, instead of one request at a time.Ek ek request ke bajaye schedule pe bahut saare records pe ek saath model chalana.