7 ms·
This is most likely aimed at people running models locally. And a homelab with 3090s/4090s is one or two orders of magnitude cheaper than GCP, if you use them
by cypress66 4y ago
This is most likely aimed at people running models locally.
And a homelab with 3090s/4090s is one or two orders of magnitude cheaper than GCP, if you use them continuously.
- SomeHacker44 4y agoI do not know anyone offhand with a 200+GB RAM home computer. The GPU is not all that is needed; you need to keep the parameters and other stuff in memory too.
- Filligree 4y agoRunning it off a fast NVMe apparently works. I don't know what the performance is like, though.
- zargon 4y ago256gb of ddr4 rdimms only costs about $400 right now. $200 for ddr3. Not uncommon in homelabs. I don't think 200gb ram is actually required, that's just what that cloud vm was spec'd with. Though the 175b model should see benefit with ram even beyond 200gb.
- woadwarrior01 4y agoI own a two year old headless home computer with 256GB of RAM and two 3090s. I ssh into it from my mac to run ML training jobs.
- hedgehog0 4y agoWhat’s the price may I ask
- alex_sf 4y agoI have a similar setup. GPUs were $1.6k US, rest of the system was another ~$1k. This includes 256GB RAM and dual Xeons.
- zac_hudson 4y agoI bought an old server from ebay, and ripped the guts out to make a desktop computer. 128GB of ddr3 ram and 48 E5 v2 xeons for 300$.