35 ms·
You need to own that or buy someone else's compute to run any LLM. The marginal cost of the open local models is free.
by nateglims 2y ago
You need to own that or buy someone else's compute to run any LLM. The marginal cost of the open local models is free.
- Arainach 2y agoYou can get a LOT of compute credits, at the public rates the cloud providers charge (not OpenAI's discount) for the price of an NVIDIA 4xxx with 24GB or more of RAM. Enough to do what most people need AI to do for a long time.