5 ms·
Hmm. Seems like a bad deal. This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670. And to actually train stuff
by andersa 2y ago
Hmm. Seems like a bad deal.
This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670.
And to actually train stuff you'd likely want nodes with more of them, like 8, or just different GPUs all together (like A100/H100/etc).
- indigodaddy 2y agoHow long I wonder before these sorts of things will be affordable to the more everyday person say sub-$100?
- andersa 2y agoNot before the bubble pops.
- jsheard 2y agoEven when it does, GPUs with more VRAM than a flagship gaming model have always and will always come at a massive price premium. That ceiling is currently 24GB, if you need more than that it's going to cost you.
- rafaelmn 2y agoI don't see why. AMD could buy a lot of free community work just by putting out a 32 GB version of their next gen flagship at around 1k. Not chasing the margin for a generation would buy them a decent amount of community support - they need it if they want to compete with Nvidia at any point. Ahh I just saw OP was saying sub 100$ - yeah that's never going to happen.
- InvaderFizz 2y agoVRAM is such a small portion of the BOM that they could double it, keep the same margins, and the MSRP would only increase by like $300. The problem isn't margin on the consumer cards, the problem is competing with their even higher margin workstation cards.
- rafaelmn 2y agoThing is AMD can't have Nvidia margins because nobody supports them - take a hit for a generation on pro sales - get market/mind share and then you have a chance to play the same game.
- lugao 2y ago> next gen flagship at around 1k Have you seen GPU prices lately (last 5 years)? A RTX 4080 super with merely 16 GB of VRAM is at least 1k, there's no way a 32 GB next gen flagship would be released at this price range.
- rafaelmn 2y agoI don't see Nvidia canibalizing their server cash cow, but AMD has much less to lose and more to gain.
- nusl 2y agoWell, you get the entire server and not just a GPU, so you can do what you want with it.
- JosephRedfern 2y agoThat's not a like-for-like comparison, though. ~2TB local NVMe storage included here, 10 (70%) more CPU cores, and more than twice the RAM.
- dist-epoch 2y agoThe non-GPU part is like $70 a month (also at Hetzner).
- kirab 2y agoHetzner customer here. It’s a little hard to understand in the UX, but the price shown is the monthly max price. It is actually paid by the hour. The price per hour for this server is € 1.5980 more info: https://docs.hetzner.com/general/others/new-billing-model/ https://docs.hetzner.com/general/others/new-billing-model/
- reitzensteinm 2y agoBut the setup fee is €86.90. Is that not paid each time you provision the server?
- dindresto 2y agoThat's incorrect, dedicated Hetzner servers do not have hourly pricing. That only applies to Hetzner Cloud.
- reitzensteinm 2y agoThat's incorrect. Dedicated servers do now offer hourly pricing. See this page which lists the hourly pricing for the new GEX130 server: https://www.hetzner.com/dedicated-rootserver/matrix-gpu/ https://www.hetzner.com/dedicated-rootserver/matrix-gpu/ But, as far as I know (hence the sibling question), you still need to pay the setup fee each time you launch.
- dindresto 2y agoThanks for the link, seems like a major flaw to combine hourly pricing with a setup fee. :')
- dindresto 2y agoActually rechecking the terms of the GPU server, it states: > Cancellation period: 30 days to the end of the month To me that indicates it's not possible to order the server for only a few hours.
- kirab 2y ago