2 ms·
The students who are really interested in AI will buy desktop PC anyway. And the fact that they can use the same GPU for model training and for playing Diablo I
by Detrytus 3y ago
The students who are really interested in AI will buy desktop PC anyway. And the fact that they can use the same GPU for model training and for playing Diablo IV makes the whole investment easier to justify.
- wing-_-nuts 3y agoI dunno man, stuff like google collab is ubiquitous for students these days. I asked about building a pc on the AI/ML subs on reddit and people basically and the default advice was that few did that these days, and they're right, compute prices have been really low until recently even if you decided to go with premium offerings.
- ethbr1 3y agoIf you don't have a house with space that you expect to stay in for awhile, laptop+cloud is too compelling to make anything else worth it. If you start having physical space guarantees, then the calculus changes...
- wing-_-nuts 3y agoLast time I did the math, by the time I spent 4090 money on compute, I could have been done with a PHD. Now, if all you need is a 3060? Yeah you could probably make that work, but you wouldn't be doing LLM inference even quantized
- jpdus 3y agoEither you only use the GPU sporadically or your math is very different from Tim Dettmers` [1]: "The break-even point for a desktop vs a cloud instance at 15% utilization (you use the cloud instance 15% of time during the day), would be about 300 days ($2,311 vs $2,270):" And that was written before the current GPU crunch and assumes availability in the cloud, which currently is not a given at all. [1] https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/ https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni...
- wing-_-nuts 3y agoThanks for the source! Very helpful for future reference.