3 ms·
Calling a Mac Studio equipped with 192GB of RAM "consumer grade" is a big stretch. "Consumer ${thing}" to me is somewhere =< $3000.
by rrrix1 3y ago
Calling a Mac Studio equipped with 192GB of RAM "consumer grade" is a big stretch.
"Consumer ${thing}" to me is somewhere =< $3000.
- karolist 3y agoTrue, but you get a full general compute machine for under $6k, after a few years you can sell it for 3-4k and upgrade to the latest one. Personally I think it's the best thing to happen to local LLMs, by accident. I have an M1 Max 64GB and I'm blown away every day by these local models. Apple didn't plan for it, but it happened by accident due to unified memory with godzillion throughput having integrated silicon.