3 ms·
And here I was in bliss with the 32k context increase 3 days ago. 128k context? Absolutely insane. It feels like now the bottle neck in GPT workflows is no long
by zavertnik 3y ago
And here I was in bliss with the 32k context increase 3 days ago. 128k context? Absolutely insane. It feels like now the bottle neck in GPT workflows is no longer GPT, but instead its the wallet!
Such an amazing time to be alive.
- naiv 3y agonow with the prices reduced so much even the wallet might not be the bottle neck anymore
- in3d 3y agoFor GPT-4 Turbo, not GPT-4.
- dragonwriter 3y agoGPT-4-Turbo seems to be replacing GPT-4 (non-turbo); the GPT-4 (non-turbo) model is marked as "Legacy" in the model list. EDIT: the above is corrected, it previously erroneously said the non-turbo model was marked as "deprecated", which is a different thing.
- kridsdale3 3y agoYes, nowhere in the text today was there any assertion that Turbo produces (eg) source code at the same level of coherence and consistently high quality as GPT4.
- somsak2 3y agoWas there an assertion that it doesn't?
- bart_spoon 3y agoAltman did specifically say it’s a “better model” than GPT4, but that’s “better” is vague enough that it might not actually be in terms of accuracy.
- daguava 3y ago[dead]
- weird-eye-issue 3y agoThey specifically said it's a better model
- marban 3y agoComment will not age well.
- Swizec 3y ago> 128k context? Absolutely insane 128k context is great and all, but how effective are the middle 100,000 tokens? LLMs are known to struggle with remembering stuff that isn't at the start or end of the input. Known as the Lost Middle https://arxiv.org/abs/2307.03172 https://arxiv.org/abs/2307.03172
- saliagato 3y agosama said they improved it
- Der_Einzige 3y agoWe can't just take his word for it. This needs experimental verification. It's likely not even close to solved.
- drcode 3y agopeople now have access and can do any verification they want
- gjm11 3y agoIn fairness, humans have much the same problem.
- MagicMoonlight 3y agoIt’s insane because it makes no sense. When you read a book you don’t remember the last 100,000 words. It’s so wildly inefficient to do it that way.
- lucubratory 3y agoHuh? By the time you finish reading a book you've forgotten the book?
- stavros 3y agoThe specific words, yes.