3 ms·
I've ran a comparison benchmark for the smaller models https://gist.github.com/mhitza/f5a8eeb298feb239de10f9f60f8411a7 https://gist.github.com/mhitza/f5a8eeb298
by mhitza 1y ago
I've ran a comparison benchmark for the smaller models https://gist.github.com/mhitza/f5a8eeb298feb239de10f9f60f8411a7 https://gist.github.com/mhitza/f5a8eeb298feb239de10f9f60f841...
Comparing it against the RTX 4000 SFF Ada (20GB) which is around $1.2k (if you believe the original price on the nvidia website https://marketplace.nvidia.com/en-us/enterprise/laptops-workstations/nvidia-rtx-4000-sff-ada-generation/ https://marketplace.nvidia.com/en-us/enterprise/laptops-work...). Which I have access to on a Hetzner GEX44.
I'm going to ballpark it between 2.5-3x faster than the desktop. Except for the tg128 test, where the difference is "minimal" (but I didn't do the math).
- yencabulator 1y agoThe whole point of these integrated memory designs is to go beyond that 20 GB VRAM.
- throwdbaaway 1y agoActually, you can combine them. When compared to Mac Studio, the main advantage of these Strix Halo boxes is that you still add a bunch of egpu over usb4/oculink, for better PP.
- Tsiklon 1y agoI see Wendell of Level1Techs combines the two in his video on this system. Theoretically you can have the best of both worlds if you don’t mind running an Occulink E-GPU enclosure https://youtu.be/L-xgMQ-7lW0 https://youtu.be/L-xgMQ-7lW0