3 ms·
> There are many companies that sell tokens from an API I was just at Dell Tech World and they proudly displayed a slide during the CTO keynote that said: "Co
by latchkey 1y ago
> There are many companies that sell tokens from an API
I was just at Dell Tech World and they proudly displayed a slide during the CTO keynote that said:
"Cost per token decreased 4 orders of magnitude"
Personally speaking, not a business I'd want to get into.
- ryao 1y agoSome context is needed for this. The only way to get a 4 orders of magnitude difference would be to compare incomparable things, like OpenAI’s most expensive model versus llama 3.1 8B.