5 ms·
Your order of magnitude claim is off by almost an order of magnitude. It's more like half again as good on a couple of items and the same on the rest. 10X impro
by asadotzler 2y ago
Your order of magnitude claim is off by almost an order of magnitude. It's more like half again as good on a couple of items and the same on the rest. 10X improvement claims is a joke people making claims like that ought to be dismissed as jokes too.
- ertgbnm 2y ago$30 / million tokens to $5 / million tokens since GPT-4 original release = 6X improvement 4000 token context to 128k token context = 32X improvement 5.4 second voice mode latency to 320 milliseconds = 16X improvement. I guess I got a bit excited by including cost but that's close enough to an order of magnitude for me. That's ignoring the fact that's it's now literally free in chatGPT.
- hn_throwaway_99 2y agoThanks so much for posting this. The increased token length alone (obviously not just with OpenAI's models but the other big ones as well) has opened up a huge number of new use cases that I've seen tons of people and other startups pounce on.