3 ms·
This is true, but... RTX 4090 has only 24GB RAM and M3 can run with 192GB RAM... A game changer for largest/best models...
by pulse7 2y ago
This is true, but... RTX 4090 has only 24GB RAM and M3 can run with 192GB RAM... A game changer for largest/best models...
- talldayo 2y agoCUDA features unified memory that is only limited by the bandwidth of your PCIe connector: https://developer.nvidia.com/blog/unified-memory-cuda-beginners/ https://developer.nvidia.com/blog/unified-memory-cuda-beginn... People have been tiling 24gb+ models on a single (or several) 3090/4090s for a while now.
- seec 2y agoShhh, don't correct the believers, they might learn something.