29 ms·
Ryzen 7 8700G is an APU, and it has built-in Radeon 780M GPU (12 CUs, ~12.6 TFLOPS, plus an NPU). This is not very strong, but this is floor which runs local mo
by denn-gubsky 2mo ago
Ryzen 7 8700G is an APU, and it has built-in Radeon 780M GPU (12 CUs, ~12.6 TFLOPS, plus an NPU). This is not very strong, but this is floor which runs local models for me and saves a lot of paid tokens. Potentially this setup may be upgraded to AI MAX when AM5 APUs will become available in box packages (now they are OEM-availabe only). The most expensive part of my system is DDR5, and it may be reused in case of upgrade. Actually, this is my self-hosted NAS (TrueNAS Scale) which also runs Ollama and serves as my local inference machine.