3 ms·
If you want to run better models, you need one of the more expensive GPUs, like an H100 or such ($40k). I don't think any of the smaller models are remotely com
by TheDong 6mo ago
If you want to run better models, you need one of the more expensive GPUs, like an H100 or such ($40k). I don't think any of the smaller models are remotely comparable to anthropic.
The GPU also takes around $500-$1000 in electricity, and even then you won't be able to run a model of as good quality as anthropic.
It's also hard to justify since who knows how quickly it will be outdated, like maybe soon you'll need a blackwell chip (like a $100k PC, check out the NVIDIA DGX Station) to run a decent model.
... It'll take a lot more than a year to pay back a model capable of running openclaw with any sort of reasonable performance.
Or can you report that you've had good luck with a Strix Halo or local GPU for less than $40k up-front costs?
- deleted 6mo ago[deleted]