What is Monitoring?Monitoring kya hai?

🧸 Think of it likeAise samjho

Like the health monitor beside a hospital bed that beeps when something goes wrong.Hospital bed ke paas wale health monitor jaisa jo kuch galat hone pe beep karta hai.

📘 ExplainedVistaar se

For models: system metrics (latency, errors), data (missing values, drift), predictions (distribution, confidence), real performance when labels arrive, and business metrics. For LLM apps: traces of every step, token cost, feedback and eval scores. Each alert should map to an action.Models ke liye: system metrics (latency, errors), data (missing values, drift), predictions (distribution, confidence), labels aane pe asli performance, aur business metrics. LLM apps ke liye: har step ke traces, token cost, feedback aur eval scores. Har alert ka ek action hona chahiye.

💡 Real exampleAsli example

An alert fires when 20% of a feature's values are suddenly missing.Ek feature ki 20% values achanak missing hone pe alert bajta hai.

📖 Learn it step by stepStep by step seekho

• Monitoring models: drift and silent failuresModels ki monitoring: drift aur chupke se hone wale failures

🔗 Related termsJude hue shabd

• Data driftWhen the data a live model receives starts to look different from its training data.Jab live model ko milne wala data uske training data se alag dikhne lage.
• Concept driftWhen the relationship between inputs and the right answer changes over time, so a trained model gets worse.Jab inputs aur sahi jawaab ka rishta waqt ke saath badal jaata hai, aur trained model kharab hone lagta hai.
• LatencyHow long a request takes from asking to getting the answer.Request bhejne se jawaab milne tak kitna time lagta hai.