3 ms·
How representative is this platform of the bigger GB200 and GB300 chips? Could I write code that runs on Spark and effortlessly run it on a big GB300 system wi
by OliverGuy 1y ago
How representative is this platform of the bigger GB200 and GB300 chips?
Could I write code that runs on Spark and effortlessly run it on a big GB300 system with no code changes?
- xs83 1y agoIf you mean CUDA specific then yes. The biggest benefit of these machines over the others is the CUDA ecosystem and tools like cuDF, cuGraph etc
- egeres 1y agoAll three (GB10, GB200 and GB300) are part of the Blackwell family, which means they have Compute Capability >= 10.X. You could potentially develop kernels to optimize MoE inference (given the large available unified memory, 128Gb, it makes the most sense to me) with CUDA >= 12.9 then ship the fatbins to the "big boys". As many people have pointed out across the thread, the spark doesn't really has the best perf/$, it's rather a small portable platform for experimentation and development