3 ms·
>48GB ram 48GB VRAM? 48+ gigabytes of system ram is cheap, 48 gigabytes of ram on a GPU is still painfully expensive.
by sbierwagen 5y ago
>48GB ram
48GB VRAM? 48+ gigabytes of system ram is cheap, 48 gigabytes of ram on a GPU is still painfully expensive.
- charcircuit 5y agoYes, vram
- x3al 5y agoWould m1 max work?
- blovescoffee 5y agoRight now there's meh Deep Learning support on the m1 max. TensorFlow is ~supported~, PyTorch is not. Apple has their Neural Engine and CPU/GPU architectures sort of hidden and so it's hard to port or support them.
- schleck8 5y agoGPUs are the slowing factor in general if I'm not mistaken when it comes to Deep Learning progress.
- moffkalast 5y agoYes, in this GPU market that's essentially a new car's worth of cash.
- robbedpeter 5y agoOr $10 a month for colab or any of the various and sundry cloud services available. If you end up needing a dedicated service, huggingface is phenomenal - the barriers to using large language models are trivial.
- JudasGoat 5y agoThe Amd APU's would be interesting although under powered. They give you the option of setting "VRAM" size to almost any percentage of system memory.