2 ms·
It's definitely usable past 48GB, I have a 96GB M2 Max and regularly run models that use around 70GB that are very usable. I also have a home server with 2x309
by smcleod 2y ago
It's definitely usable past 48GB, I have a 96GB M2 Max and regularly run models that use around 70GB that are very usable.
I also have a home server with 2x3090 and 2xA4000 (80GB vRAM) - yes it's a lot faster, but it's a pain in the ass to build, it takes up a lot of space, uses 10x the power, and honestly - cost about the same as my MacBook Pro.