3 ms·
"Query" is ambiguous, because ChatGPT runs on "tokens", not "queries". In real life you will want an order of magnitude more tokens if you're generating somethi
by otabdeveloper4 4y ago
"Query" is ambiguous, because ChatGPT runs on "tokens", not "queries".
In real life you will want an order of magnitude more tokens if you're generating something useful and not just testing/playing.
Compute doesn't get cheaper over time, it gets more expensive.
This isn't 1993 anymore.
- funstuff007 4y agoIt's only getting more expensive because we've let AWS, Google Cloud, and Azure own all the machines.