4 ms·
> For users with more than 300GB of VRAM, qwen3-coder:480b is also available locally. I haven't really stayed up on all the AI specific GPUs, but are there rea
by mike_d 1y ago
> For users with more than 300GB of VRAM, qwen3-coder:480b is also available locally.
I haven't really stayed up on all the AI specific GPUs, but are there really cards with 300GB of VRAM?
- bakugo 1y agoNo, you need multiple GPUs. These models are not intended to be run by the average user.
- OneDeuxTriSeiGo 1y agoNot necessarily. You need either multiple GPUs or unified memory. There are a handful of UM platforms out there nowadays (mainly Macs but AMD has some as well albeit none with 300GB ram)
- packetslave 1y agoAlso the just-released DGX Spark from Nvidia (although it "only" has 128gb of unified memory)
- Computer0 1y agoOne of its defining features is the ability to link them together at speeds about the same as their ram speed iirc.
- Hamuko 1y agoYou can buy an M3 Ultra Mac Studio and configure it with 512 GB of memory shared between the CPU and the GPU. Will set you back about $9500.
- Schlagbohrer 1y agoAnd that'll be two orders of magnitude slower right?
- speedgoose 1y agoIn addition to the already mentioned Apple Mac Studio, NVIDIA sells the GH200 with up to 480GB of VRAM. My local HPC went for the 120GB version though, but 4 per node.