11 ms·
Where is AMD in all this? Like M1 Macs, their Ryzen APUs have access to the whole system memory and AI accelerators, so I would like to get a laptop with 32-64G
by FirmwareBurner 3y ago
Where is AMD in all this? Like M1 Macs, their Ryzen APUs have access to the whole system memory and AI accelerators, so I would like to get a laptop with 32-64GB of RAM just to fit giant LLMs in it, instead of splurging a lot more on RTX cards with large VRAM even if I don't game, but AMD isn't even trying.
- T-A 3y agohttps://www.reuters.com/markets/deals/amd-acquire-ai-software-startup-effort-catch-nvidia-2023-10-10/ https://www.reuters.com/markets/deals/amd-acquire-ai-softwar...
- FirmwareBurner 3y agoSure, but Apple laptops can run Llama right now. How many years do we have to wait till AMDs aquisition efforts materialize in products we can buy?
- kramerger 3y agoI dont understand, are you claiming non-Apple devices cannot run LLMs? https://github.com/ggerganov/llama.cpp/issues/34 https://github.com/ggerganov/llama.cpp/issues/34 If you meant eGPU support, IIRC that is beta for everyone right now.
- KeplerBoy 3y agoDDR4 and DDR5 are nowhere near as fast the memory in Apple's SoCs or GDDR6X found on modern GPUs.
- FirmwareBurner 3y agoBut AMD can in theory also use the same DRR that Apple uses. There ale laptops already with LPDDR5X-8000 frequency.
- IshKebab 3y agoReally? Wikipedia says DDR5 supports 8 GT/s and GDDR6X supports 16. I mean I guess they go a lot wider on a GPU, but there's no reason an APU couldn't do that too.
- KeplerBoy 3y agoYeah, sure in theory they could build chips with 384 bit memory controllers for that sweet bandwidth, but something tells me they won't.
- rowanG077 3y agoThey already do that for the top end threadrippers pros. AMD Threadripper Pro 5995wx for example has 8 memory channels that's a 512-bit memory bus.