4 ms·
I love how they frame High-end desktops and laptops as having "a single H100 GPU".
by PeterStuer 1y ago
I love how they frame High-end desktops and laptops as having "a single H100 GPU".
- organsnyder 1y agoI read that as it runs in data centers (H100 GPUs) or high-end desktops/laptops (Strix Halo?).
- xyc 1y agoI'm running it with ROG Flow Z13 128GB Strix Halo and getting 50 tok/s for 20B model and 12 tok/s for 120B model. I'd say it's pretty usable.
- organsnyder 1y agoExcellent! I have a Framework Desktop with 128GB on preorder—really looking forward to getting it.
- robertheadley 1y agoI actually tried to ask the Model about that, then I asked ChatGPT, both times, they just said that it was marketing speak. I was like no. It is false advertising.
- phh 1y agoWell if nVidia wasn't late, it would be runnable on nVidia project Digits.
- PeterStuer 1y agoYes, they are late to the party. Maybe they do not want to eat into the RTX Pro 6000 sales. In the meantime, there is the AMD Ryzen™ Al Max+ 395.
- piskov 1y agoDon’t forget about mac studio