3 ms·
>What to do with all that computing power now. I guess AI. For AI, the lack of memory is pretty limiting. Having a ton of 8 GB or 10 GB memory GPUs (3070/3080
by JonathanFly 4y ago
>What to do with all that computing power now. I guess AI.
For AI, the lack of memory is pretty limiting.
Having a ton of 8 GB or 10 GB memory GPUs (3070/3080) is annoying and often just not even possible to use effectively without designing specifically to it. If they get really really cheap maybe they'll be some tools or models that are built to leverage scenarios like that, it's not impossible, but for now it's probably just the cheap 3090s (24GB of memory) that will benefit AI.
- dannyw 4y agoI picked up a cheap ex-mining 3090 last week. Amazing for a ML hobbyist. Works out so much cheaper over time than paying for cloud GPUs. A couple weeks of training and I break even.
- MonkeyMalarky 4y agoFeels like distributed model training would be the ultimate yak shaving exercise for training ML models at home. Sure you can do it, the cost of the lower memory cards is super attractive, you'll definitely learn lots of cool things, and, after all the effort you will have made exactly no progress on the original task you set out to do. Kind of like the choice between making a video game or a game engine.