3 ms·
Yes, the new Ryzen APU's might have 128G, great for running LLMs. https://videocardz.com/181601/amd-testing-strix-halo-apu-with-128gb-memory-config https://vide
by fsiefken 2y ago
Yes, the new Ryzen APU's might have 128G, great for running LLMs.
https://videocardz.com/181601/amd-testing-strix-halo-apu-with-128gb-memory-config https://videocardz.com/181601/amd-testing-strix-halo-apu-wit...
Perhaps some other party will come up with Groq like performant LPUs and LLMs will get more precise and efficient. I read that more and more people are running their LLMs locally.