6 ms·
$12,299
by snarfy 11d ago
$12,299
- andrekandre 11d ago5 years of (200/month) tokens at that price, meanwhile an rtx 5090 pc is about half that… hmm but i wonder how much these token costs are sustainable or not, it may be in the long term cheaper to have your own hardware if token costs go up (and hopefully hardware gets cheaper again)
- chasd00 11d agoThe token price isn't the only reason to run a model locally though. You can do additional training to specialize or remove censorship that may be a no-no per TOS with cloud GPUs.
- drdaeman 11d agoCloud GPUs have ToS about purposes you’re allowed to crank numbers for? I thought this only applies to LLM inference providers, but not raw GPU rentals.
- Eisenstein 11d ago$2200 for a 64GB VRAM machine if you are willing to do a bit of work. * https://imgur.com/mpdorVJ https://imgur.com/mpdorVJ
- drdaeman 11d agoThose tokens aren’t guaranteed (esp. with RE and security tasks - rooted my own TV last week, Claude crapped out on “cyber safety” grounds), and you’re throwing money at entities that aren’t aligned with your interests instead of entities who are interested in actually empowering you.