sliken

14 ms·

151.
by sliken 2y ago
Awesome. Maybe there will be storage options of 1,2,and 4TB and optional 25/100/200/400 GBit interfaces. Or maybe everything except the CPU/GPU is constant, but having a 50%, 75%, or 100% of the CPU/GPU cores so th
152.
by sliken 2y ago
Keep in mind that a kernel module != driver. It's just doing initialization and passing data to/from the driver, which is closed source and in user space.
153.
by sliken 2y ago
I did want a M2 max studio, ended up with a 12 core Zen 4 + radeon 7800 XT for about half the money. A Nvidia Project Digit/GB10 for $3k with 128GB ram does sound tempting. Especially since it's very likely to have standard NVMe
154.
by sliken 2y ago
The quotes I've seen mention the maximum config (128GB ram and 4TB of storage) and the minimum price. Nothing saying $3k for 128GB ram and 4TB of storage. I hope I'm wrong, but I'm betting the max price is at least twice th
155.
by sliken 2y ago
Good catch, they called it "Grace Blackwell". Changing the CPU cores completely and calling it Grace seems weird. Maybe it was just a mistake during the keynote.
156.
by sliken 2y ago
AMD Strix Halo is 256GB/sec or so. Similarly AMD's Epyc Sienna family is similar. The EPYC turin family (zen 5) has 576GB/sec or so per socket. Not sure how well any of them do on LLMs. Bandwidth helps, but so does hardw
157.
by sliken 2y ago
Yes, but ECC is inline, so it costs bandwidth and memory capacity.
158.
by sliken 2y ago
Not really, 575 watts for the GPU is going to make it tough to cool or provide power for.
159.
by sliken 2y ago
Might well be, from what I can tell the price "starts at $3k", which might well be config'd like the minimum mac studio for RAM and storage. Mac studios easily hit $5k-$6k or more.
160.
by sliken 2y ago
I believe $3,000 is for the unmentioned minimum config, no idea on the mentioned 4TB storage and 128GB ram version. Running a 96GB ram model isn't cheap (often with unified memory 25% is reserved for CPUs), so maybe it will win there.
161.
by sliken 2y ago
On the CPU size the Neoverse N2 doesn't compete particularly well with apple's M4, or the Zen5 for the matter. Bit bit hard to tell what's on offer on the GPU side, I wouldn't be surprised if it was RTX 4070 to 5070 in t
162.
by sliken 2y ago
The keynote mentioned that it could be used as a Linux workstation.
163.
by sliken 2y ago
Not sure how to judge better price/perf. I wouldn't expect 20 Neoverse N2 cores to do particularly well vs 16 zen5 cores. The GPU side looks promising, but they aren't mentioning memory bandwidth, configuration, spec, or pe
164.
by sliken 2y ago
Likely too late, Nvidia's claiming 4090 Perf @ $549, shipping this month.
165.
by sliken 2y ago
Sounds quite a bit like the Strix Halo (16 zen5 cores, 256 bits wide @ 8533 MHz). Hard to tell but I'd expect better GPU (and AI/ML perf) but worse CPU performance (Arm Neoverse N2 vs AMD Zen 5). Sounds quite a bit more expensive
166.
by sliken 2y ago
Sure, but the previous iterations (like Strix in the non-halo form) and similar AMD laptop chips are popular with numerous SFFs from the likes of ASUS, ASRock, Gigabyte, Beelink, Minisforum, GMKtex, Lenovo, and many others. I've heard
167.
by sliken 2y ago
Keep in mind that China is a large energy importer, so producing more power inside the country is of strategic importance, especially if you are planning a future war which is very likely to include sanctions. China imports a large amount o
168.
by sliken 2y ago
After digging it looks like 70B Q4 requires 35GB or so. So yes the AMD comparison is a strix halo not swapping vs a 4090 that is swapping. Seems kinda misleading, but is a real advantage for larger models.
169.
by sliken 2y ago
Seems unlikely, at least for any normal use case. PCIe 5.0 (the current standard that is widely shipping) has 16GB/sec in each direction (32GB/sec total) with a x4 connection. Doubly so that for the last decade or so memory sizes
170.
by sliken 2y ago
It mentioned Q4, but after searching around a bit looks like 70B-Q4 need 35GB or so. So strix halo is 2.2x faster than a 4090 when it's paging to system ram. Not so impressive 8-(.
171.
by sliken 2y ago
Like a SFF desktop with a big 140mm fan on top. Here's hoping.
172.
by sliken 2y ago
I'm optimistic that it won't be a big issue. After all if 256 bit wide memory helped a wide range of application it would have been added earlier. After all xbox and playstation have had similar for 2 generations so far. The band
173.
by sliken 2y ago
There's a laptop AND a desktop, called the HP Z2 Mini G1a. https://www.pcworld.com/article/2567865/hp-z2-mini-g1a-packs...
174.
by sliken 2y ago
I hope the LLM benchmarks announced were reasonable and not something gross like using a model that doesn't swap on the Strix Halo, but does on a 4090. HP announced a HP Z2 mini g1a, which is bigger than a NUC, but I believe still cons
175.
by sliken 2y ago
True, but apple's the benchmark in this space and have managed thin laptops with good battery life and decent (but not class leading) GPU performance. Doubling the memory width (and tripling the bandwidth) helped Apple's GPU perfo
176.
by sliken 2y ago
Right, but none wider than 128 bits, unless you count PS5 and XboxX.
177.
by sliken 2y ago
Various leaks have claimed that some products would ship with DDR5-8533 which is 266GB/sec. I wouldn't be surprised if a range of frequencies ship with the 1st gen devices. Maybe even a SFF sized motherboard that allows CUDIMMs,
178.
by sliken 2y ago
Even M4 Pro is a big step up. M4 max is pretty expensive and I suspect AMD is targetting a lower price point, not that any prices were mentioned today. 256 bits * DDR5-8533 is a pretty big step up from any other x86-64 laptop or SFF and sh
179.
by sliken 2y ago
The strix halo announce was pretty much exactly what was leaked. However one big surprise was that the Halo 395 chip runs Llama 3.1 70B-Q4 2.2x times faster than a RTX 4090 24GB. Anyone have any details? The slide mentions seeing AMD end
180.
by sliken 2y ago
Assuming it works from a terminal session, maybe try: https://asciinema.org/ It can be self hosted if you want.

More ›