3 ms·
1000 tokens/s is pretty fancy. I just wonder how sustainable the pricing is or if they are VC-fueled drug dealers trying to convert us into AI-coholics... It i
by dust42 11mo ago
1000 tokens/s is pretty fancy. I just wonder how sustainable the pricing is or if they are VC-fueled drug dealers trying to convert us into AI-coholics...
It is definitely fun playing with these models at these speeds. The question is just how far from real pricing is 500M tokens for $50?
Either way the LLM usage will grow for some time to come and so will grow energy usage. Good times for renewables and probably fusion and fission.
Selling shovels in a gold rush was always reliable business. Cerebras is only rated at $8.1B as of one month ago. Compared to Nvidia that seems pocket change.