The lost-in-the-middle problem and why retrieval beats stuffing

Your agent has a 200K token context window. So you dump everything in there — MEMORY.md, daily logs, project notes, old conversations — and figure the model will sort it out. It won't. The research says your middle context is a dead zone In 2023, researchers from Stanford, UC Berkeley, and Samaya AI published "Lost in the Middle: How Language Models Use Long Contexts." They tested models on tasks where the relevant information was placed at different positions in the input. The results were consistent: models performed best when key information appeared at the very beginning or the very end of the context. Information in the middle got ignored. This wasn't a fluke finding. Nelson Liu and the team tested across multiple model families and context lengths. Performance degraded significantly — sometimes by 20% or more — when the answer was buried in the middle third of the input. Google DeepMind followed up with similar findings. So did Anthropic's own internal research on Claude's attent