4 ms·

> ...it offloads parts of model to SSD or main memory on both forward/backward passes So... does this murder SSDs?

• sbierwagen 3y ago
  Having the SSD soldered to the mainboard usually doesn’t matter… except for this particular use case. You could stick a SSD in a thunderbolt enclosure and use that, but at that point you might as well rent a cloud GPU instance for a buck an hour.
  • behnamoh 3y ago
    > for a buck an hour. Every decent GPU cloud I've seen is around +$3/hour. Where do you get ~$1/hour?
    • Reubend 3y ago
      Take a look at this great comment, which provides a list of affordable services. https://news.ycombinator.com/item?id=34358781 https://news.ycombinator.com/item?id=34358781 Basically, it depends a lot of what you mean by "decent". Your standards for performance might be a lot more than the person you're replying to.