3 ms·
Over a year they have provided an order of magnitude improvements on latency, context length, and cost, while meaningfully improving performance and adding seve
by ertgbnm 2y ago
Over a year they have provided an order of magnitude improvements on latency, context length, and cost, while meaningfully improving performance and adding several input and output modalities.
- deleted 2y ago[deleted]
- asadotzler 2y agoYour order of magnitude claim is off by almost an order of magnitude. It's more like half again as good on a couple of items and the same on the rest. 10X improvement claims is a joke people making claims like that ought to be dismissed as jokes too.
- ertgbnm 2y ago$30 / million tokens to $5 / million tokens since GPT-4 original release = 6X improvement 4000 token context to 128k token context = 32X improvement 5.4 second voice mode latency to 320 milliseconds = 16X improvement. I guess I got a bit excited by including cost but that's close enough to an order of magnitude for me. That's ignoring the fact that's it's now literally free in chatGPT.
- hn_throwaway_99 2y agoThanks so much for posting this. The increased token length alone (obviously not just with OpenAI's models but the other big ones as well) has opened up a huge number of new use cases that I've seen tons of people and other startups pounce on.
- jononor 2y agoAll while not addressing the rampant confabulation at all. Which is the main pain point, to me at least. Not being able to trust a single word that it says...