3 ms·
Should work just fine for MoE models where active set fits into 252GB.
by kees99 12d ago
Should work just fine for MoE models where active set fits into 252GB.
- theplumber 12d agoCan’t you do that already more or less with a Mac Studio with 256 or better 512fb of ram?
- fc417fc802 12d agoWhere are you getting 7 TB/s of memory bandwidth?
- theplumber 12d agoFair point but you get that only for 252GB of ram so it’s not even “totally better” than a Mac Studio ultra with 512GB RAM. It still the old “smaller but faster than a Mac” stuff nvidia sells.Maybe in 1-2 years they will match the Mac 512 but then Apple will release an even bigger Mac