3 ms·
They’re widely available to rent. Unless you’re running it 24/7 for multiple years, it’s not going to be cost effective to buy the GPU instead of renting a hos
by Aurornis 1y ago
They’re widely available to rent.
Unless you’re running it 24/7 for multiple years, it’s not going to be cost effective to buy the GPU instead of renting a hosted one.
For personal use you wouldn’t get a recent generation data center card anyway. You’d get something like a Mac Studio or Strix Halo and deal with the slower speed.
- varispeed 1y agoI rented H100 for training a couple of times and I found that they couldn't do training at all. Same code worked fine on Mac M1 or RTX 5080, but on H100 I was getting completely different results. So I wonder what I could be doing wrong. In the end I just use RTX 5080 as my models fit neatly in the available RAM. * by not working at all, I mean the scripts worked, but results were wrong. As if H100 couldn't do maths properly.