Context Rot — AI Glossary

Context rot is the degradation of model performance as a context window fills up with more content. Attention spreads thin across a long prompt, retrieval from mid-context positions drops relative to the beginning and end (the "lost in the middle" pattern), and small low-value chunks crowd out high-value ones.