3 ms·
The nuance is that their technique allows you to slide the context window along without introducing a jagged discontinuity in generation. At least that’s my fee
by ttul 3y ago
The nuance is that their technique allows you to slide the context window along without introducing a jagged discontinuity in generation. At least that’s my feel for it.
- fastball 3y agoYes, but is that really why people want the context window to be "infinite"? In my experience, the desire for bigger context is the ability to say, dump an 1000 page book into an LLM and ask questions about any part of it, not just the last chapter.
- ttul 3y agoI think the title is misleading. This is an MIT PR piece.