3 ms·
With this amount of VRAM, do you happen to be using a Strix Halo or a Mac?
by scott01 2mo ago
With this amount of VRAM, do you happen to be using a Strix Halo or a Mac?
- spottedmarley 2mo agoIt's a Dell Pro Max GB10. I have two that I can bridge together to run larger models across the 256GB pool but I only bridge them when I am experimenting with larger models and they will run fine but at lower tk/s with really only marginal reasoning gains, so I tend to stick to medium models (122b) on one GB10 and I use the other to serve gen models for music, image and video gen.