3 ms·
I bet they lack good long context training data and need to start a flywheel of collecting it via their api (from willing customers)
by olliepro 7mo ago
I bet they lack good long context training data and need to start a flywheel of collecting it via their api (from willing customers)
- jbergqvist 7mo agoThis would be my guess too. It can probably be generated synthetically or via agentic rollouts, but high quality long context examples where outputs meaningfully depend on long-range interactions probably remain scarce