3 ms·
An A100 GPU costs ~$10,000. You'll struggle to run even a small LLM with a GPU under $1k right now (there are some exceptions, but it's hard to find a lot of me
by datadrivenangel 3y ago
An A100 GPU costs ~$10,000. You'll struggle to run even a small LLM with a GPU under $1k right now (there are some exceptions, but it's hard to find a lot of memory under that)