5 ms·
Because they can't do long context windows. That's the only explanation. What you can do with a 1m token context window is quite a substantial improvement, part
by danpalmer 2y ago
Because they can't do long context windows. That's the only explanation. What you can do with a 1m token context window is quite a substantial improvement, particularly as you said for enterprise usage.