2 ms·
All LLMs are, it's an innate thing. Google just sucks at the kind of long context training you need to do to mitigate that.
by ACCount37 10mo ago
All LLMs are, it's an innate thing. Google just sucks at the kind of long context training you need to do to mitigate that.
- Andrex 10mo agoI would bet they won't suck at it for much longer, Gemini's progress in undeniable.
- ACCount37 10mo agoIt was a consistent weak point for Gemini, compared to other major AIs. Reportedly, still is. The progress is undeniable, the performance only ever goes up, but I'm not sure if they ever did anything to address this type of deficiency specifically. As opposed to being carried upwards by spillover from other interventions.