At the beginning it was true, the longer the context, the more the LLM was lost, but now, the new models can retrieve information anywhere in the context c.f.

At the beginning it was true, the longer the context, the more the LLM was lost, but now, the new models can retrieve information anywhere in the context c.f. https://pbs.twimg.com/media/GH2NJMxbYAAcRL3?format=jpg&name=medium https://pbs.twimg.com/media/GH2NJMxbYAAcRL3?format=jpg&name=...