What is Lost in the middle?Lost in the middle kya hai?

🧸 Think of it likeAise samjho

Like remembering the first and last songs of a long playlist but not the ones in the middle.Lambi playlist ke pehle aur aakhri gaane yaad rehna par beech wale nahi.

📘 ExplainedVistaar se

When you stuff many retrieved chunks into a long context, relevant facts in the middle can be overlooked. Mitigations: retrieve fewer, better chunks, rerank so the most relevant come first, and keep prompts focused.Jab bahut saare retrieved chunks lambe context mein thoos dete ho, beech ke relevant facts nazarandaaz ho sakte hain. Upaay: kam par behtar chunks laao, rerank karo taaki sabse relevant pehle aayein, aur prompts focused rakho.

💡 Real exampleAsli example

The right policy paragraph is chunk 14 of 25, and the model answers from chunk 2 instead.Sahi policy paragraph 25 mein se chunk 14 hai, aur model chunk 2 se jawaab de deta hai.

📖 Learn it step by stepStep by step seekho

• RAG: letting an LLM answer from your documentsRAG: LLM ko aapke documents se jawaab dene dena

🔗 Related termsJude hue shabd

• Context windowThe maximum amount of text (in tokens) an LLM can consider at once, including its answer.Ek baar mein LLM jitna text (tokens mein) dekh sakta hai uski seema, uske jawaab samet.
• RerankingA second step in search that re-scores the top results more accurately.Search ka doosra step jo top results ko zyaada accurately dobara score karta hai.
• ChunkingSplitting documents into smaller pieces before embedding them for search and RAG.Search aur RAG ke liye embed karne se pehle documents ko chhote tukdon mein todna.