3 ms·
An interview with AMD's Mike Clark, 'Zen Daddy' says 3nm Zen 5 is coming fast
- deleted 2y ago[deleted]
- sva_ 2y agoStill waiting for the Zen4 xdna NPU to be supported under Linux. Crossing my fingers that it'll actually be in 6.10 stable release. I'm generally happy with the 7840HS, but didn't previously consider that large sections of the die are simply unusable under Linux for lack of a driver.
- hedgehog 2y agoI don't know about the NPU but 6.10 fixes one of the big memory issues that affected deep learning workloads on APUs.
- dragontamer 2y agoIs there any reason to wait for the NPU when GPUs are already available? I have to imagine that today's code should assume a long delay / latency between CPU and GPU. Yeah, NPUs allow CPU/GPU communication to be sped up, but are we in a position where we should be relying upon fast CPU/GPU communications yet?
- sva_ 2y agoI prefer not to have a dedicated GPU in my everyday laptop. I'd find it cool if AMD took their Linux userbase more seriously (there are dozens of us!!1) and actually provided drivers to use the hardware they sell.
- hedgehog 2y agoOne thing to keep in mind is that most of the "NPU" type on-chip accelerators are designed to minimize power consumption for small networks (think speech recognition and video call background removal) rather than supporting big language models or anything you would do in say PyTorch. For those cases the path of least yak shaving is anything with an Ampere or newer NVIDIA GPU. I hold out some hope that the GPUs in AMD APUs will get better support but the hardware still isn't nearly as fast as contemporary NVIDIA chips.
- dragontamer 2y agoIts impossible for an iGPU to get any speed close to a dGPU, because dGPUs run independent RAM and independent cache (including gobs of "infinity" cache for AMD chips). Clocking memory at 500GB/s to 1000GB/s is a big deal when typical CPUs are only in the 50GB/s region (GPUs are on the order of 10x more bandwidth) ------- Building a latency-optimized kernel necessarily means you're programming against an obscure NPU / APU rather than the typical H100s. Performance is upside down compared to H100 or other typical GPUs, where CPU-to-GPU latency on an APU/NPU is negligible while memory-bandwidth is a precious resource. AMD made a bunch of kernels that did some silly video-based / camera-based gestures back in the Windows 8 days. So yeah, its possible to write efficient CPU-to-GPU integrated kernels that take advantage of zero-memory copies or other APU/NPU based tricks. Its just that if no popular APU/NPU comes out in the next decade, all that programming effort is for naught.
- hedgehog 2y agoThe above poster is mostly happy with a 7840HS which tells us they're a laptop user and likely looking at workloads that would work on a laptop with spare time hobby levels of effort. Modern laptop chip memory bandwidths are in the 100GB/s to 400GB/s range and empirically a run of the mill Mac is enough for a lot of people to get started even with language models, the main issue being quality of software support. Edit: To be more precise current x86 laptop chips are more like 80GB/s - 120GB/s, have to get a Mac for more than that.
- 2y ago
- tracker1 2y agoJust setup ChimeraOS on a 7945HS box for HTPC/Gaming chores... seems relatively nice so far, but still wanting to get a few things running on it.
- deleted 2y ago[deleted]
- tracker1 2y agoReally considering jumping from my 5950X to a 9950X, curious how well the large/4-slot memory issues have panned out since I decided to skip the 79xx generation entirely over it. 64gb is usually enough for me, but nice to have 128gb for the couple times I used more.
- adrian_b 2y agoI also intend to jump from a 5900X to a 9950X, because I am interested in floating-point computations and 9950X brings the greatest increase in FP throughput since 5 years ago, in 2019, when Ryzen 9 3950X provided double throughput in comparison with the Coffee Lake Refresh of the previous year. A 9950X contains 256 FP64 FMA units per socket, in comparison with the 128 FP64 FMA units of 3950X to 7950X. However, according to the AMD site, 9950X behaves as badly as 7950X when using 4 DIMMs. For a decent memory speed, you must use only 2 DIMMs. Nevertheless, this is less important than before. Now with 2 DIMMs you can have 96 GB, which should be sufficient for most applications.