4 ms·
I don't think you want iGPU for LLMs. 4090 + RAM offload would be many times faster.
by lostmsu 3y ago
I don't think you want iGPU for LLMs. 4090 + RAM offload would be many times faster.
- brucethemoose2 3y ago3090 + RAM offload is not very fast on my desktop. Its fine, but the speed hit is large. And I was thinking regular laptops as a baseline vs the base M1/M2.
- lostmsu 3y agoMacBooks don't have enough RAM to train without offloading to SSD which would be even slower.