3 ms·

Technically any newish laptop with 64GB of RAM has 64GB of "VRAM," but right now the Apple M series and AMD 7000 series are the only IGPs with any significant M

Technically any newish laptop with 64GB of RAM has 64GB of "VRAM," but right now the Apple M series and AMD 7000 series are the only IGPs with any significant ML power.

sroussey 4y ago
I’m not sure what you mean. Typically, an iGPU slices off part of RAM for the GPU at boot time, which means it’s fixed and not shared. When did this change?
- brucethemoose2 4y ago
  Its fixed at boot but (on newer IGPs) can grow beyond the initial capacity.
- lights0123 4y ago
  For Intel, it seems that per their chart under "What is the maximum amount of graphics memory or video memory my computer can use?" and discussion under "Will adding more physical memory increase my graphics memory amount?" at https://www.intel.com/content/www/us/en/support/articles/000020962/graphics.html https://www.intel.com/content/www/us/en/support/articles/000..., iGPUs included with 5th gen/Broadwell processors were their first to do so in 2014.
- fulafel 4y ago
  Full unified memory came 10 ish years ago (also powering the PS4) but I think hw ability to adjust iGPU memory without booting predated that, Intel seems to have called it DVMT.
KeplerBoy 4y ago
Doesn't it all boil down to bandwidth? AMDs IGP are way less attractive because they use rather slow DDR4/5 memory while the M2 has blazing fast memory integrated in the package. We're talking about 50 GB/s vs 400 GB/s. Nvidia's A100 has 1000 GB/s. Memory bandwidth is usually the bottleneck in GPU performance as many kernels are memory-bound (look up the roofline performance model).
- brucethemoose2 4y ago
  The AMD 6000 series has 128-bit LPDDR5 as an option, the 7000 series had LPDDR5X. This is similar to the M1/M2. The Pro/Max have double/quadruple that bus width. But they are much bigger/more expensive chips.
azeirah 4y ago
I was wondering about the integrated gpu in my desktop ryzen 7900x. I can find very little about it (or other 7000 series integrated gpus). Is this usable at all for running LLaMa in some way?

Technically any newish laptop with 64GB of RAM has 64GB of "VRAM," but right now the Apple M series and AMD 7000 series are the only IGPs with any significant ML power.

sroussey 4y ago

I’m not sure what you mean. Typically, an iGPU slices off part of RAM for the GPU at boot time, which means it’s fixed and not shared. When did this change?

brucethemoose2 4y ago
Its fixed at boot but (on newer IGPs) can grow beyond the initial capacity.
lights0123 4y ago
For Intel, it seems that per their chart under "What is the maximum amount of graphics memory or video memory my computer can use?" and discussion under "Will adding more physical memory increase my graphics memory amount?" at https://www.intel.com/content/www/us/en/support/articles/000020962/graphics.html https://www.intel.com/content/www/us/en/support/articles/000..., iGPUs included with 5th gen/Broadwell processors were their first to do so in 2014.
fulafel 4y ago
Full unified memory came 10 ish years ago (also powering the PS4) but I think hw ability to adjust iGPU memory without booting predated that, Intel seems to have called it DVMT.

KeplerBoy 4y ago

Doesn't it all boil down to bandwidth? AMDs IGP are way less attractive because they use rather slow DDR4/5 memory while the M2 has blazing fast memory integrated in the package. We're talking about 50 GB/s vs 400 GB/s. Nvidia's A100 has 1000 GB/s. Memory bandwidth is usually the bottleneck in GPU performance as many kernels are memory-bound (look up the roofline performance model).

brucethemoose2 4y ago
The AMD 6000 series has 128-bit LPDDR5 as an option, the 7000 series had LPDDR5X. This is similar to the M1/M2. The Pro/Max have double/quadruple that bus width. But they are much bigger/more expensive chips.

azeirah 4y ago

I was wondering about the integrated gpu in my desktop ryzen 7900x. I can find very little about it (or other 7000 series integrated gpus). Is this usable at all for running LLaMa in some way?