3 ms·
Can llama.cpp make use of the gpu built into the 7950x CPU? I assume that would improve performance.
by kristianp 2y ago
Can llama.cpp make use of the gpu built into the 7950x CPU? I assume that would improve performance.
- xena 2y agoThe limit is memory bandwidth, a dedicated GPU will have higher memory bandwidth than a CPU or iGPU ever will.
- menaerus 2y agoGranite Rapids memory bandwidth is between 614 and 844 GB/s.
- ryao 2y agoIt would make no difference at best for token generation and would actually run slower for prompt processing since it has fewer gflops than the CPU cores.