4 ms·
The article frequently mentions costs but never gives any numbers or a point of reference. As an outsider to LLM and training I find this disorienting. What wo
by thih9 4y ago
The article frequently mentions costs but never gives any numbers or a point of reference. As an outsider to LLM and training I find this disorienting.
What would be e.g. a total cost for a project like this?
- izzymiller 4y agoCost me about a hundred and fifty bucks, give or take. Continued GPU inference is on the order of ~50 cents a minute or something like that— but it's serverless so negligible. I think you could do it for significantly cheaper with some of the newer models i mentioned!