3 ms·
You could just rent a bare metal server with those specs
by andoando 4mo ago
You could just rent a bare metal server with those specs
- nullsanity 4mo ago[dead]
- girvo 4mo agoYes I could, but that is annoying because of spot pricing and having my instance shut down, and it has fluctuating prices It’s also annoying because then I need to make sure my little “lab” setup is well automated, and I’m lazy :) Also, I literally said “ It's not financially a good idea” so I’m confused why you think I don’t know that.
- adastra22 4mo agoSpot pricing and instance availability don’t apply to on metal hosting. You’d have your own machine dedicated to your own use only, at a locked in price.
- girvo 4mo ago> renting really does beat owning, and cloud beats both
- girvo 4mo agoWait, I went and looked far and wide today and I can’t find anything with ~100GB of VRAM that isn’t $20k a year, what am I missing
- adastra22 4mo agoThat's too small. I was quoted a machine with ~1.5TB of vram, for $10k/mo. This was the minimum node size in the AI data center I was talking with -- they don't make smaller nodes that you can lease as bare metal. There is no public pricing though, and you had to know people to get in.