3 ms·
Not only Apple does that. Intel and AMD have CPUs with integrated GPUs that do not have their own VRAM and use system memory. Why cannot they be used for LLMs?
by codedokode 3y ago
Not only Apple does that. Intel and AMD have CPUs with integrated GPUs that do not have their own VRAM and use system memory. Why cannot they be used for LLMs? They don't cost an arm and a leg.
- jamesTee49 3y ago[dead]
- hmottestad 3y agoIntel Iris Xe can use half of the available memory. I don’t think it will help much though, the GPU is not very powerful and the bandwidth is around 90 GB/s. The M2 Ultra in the Mac Studio has 800 GB/s. The Nvidia A40 has 696 GB/s while the Nvidia H100 SMX has 3.35 TB/s, which is probably the best you could get today. https://www.intel.com/content/www/us/en/support/articles/000020962/graphics.html https://www.intel.com/content/www/us/en/support/articles/000...