Lost in the Middle — AI Glossary

Lost in the middle is the finding from Liu et al. (2023) that language models' ability to recall information degrades sharply for content placed in the middle of a long context, even when the total context length is well under the nominal window limit.