19 ms·
Love it, they're teaching LLMs how to skim texts properly, which is exactly the right approach for handling long contexts.
by Nav_Panel 11mo ago
Love it, they're teaching LLMs how to skim texts properly, which is exactly the right approach for handling long contexts.
- ProofHouse 11mo agowasn't this the attention sink concept to some degree? I mean it doesn't seem out of the realm of possibility that if the latency overhead isn't signifigant, that frontier models start adopting similar to DeepSeek OCR tech