6 ms·
For $30/month I could buy a GPU all for myself, they can serve a huge number of users from one GPU, how can it be that expensive?
by rjh29 3y ago
For $30/month I could buy a GPU all for myself, they can serve a huge number of users from one GPU, how can it be that expensive?
- datadrivenangel 3y agoAn A100 GPU costs ~$10,000. You'll struggle to run even a small LLM with a GPU under $1k right now (there are some exceptions, but it's hard to find a lot of memory under that)