4 ms·
I thought google Gemini had almost perfect needle in haystack performance inside 1 million tokens?
by m3kw9 2y ago
I thought google Gemini had almost perfect needle in haystack performance inside 1 million tokens?
- sftombu 2y agoThe reason I made Needle in a needlestack is the LLMs are getting to good at needle in a haystack. Until GPT-4o, no model was good at the NIAN benchmark.