3 ms·
Not exactly what you've asked but Mac Studio exists, with 192GB at that.
by karolist 3y ago
Not exactly what you've asked but Mac Studio exists, with 192GB at that.
- rrrix1 3y agoCalling a Mac Studio equipped with 192GB of RAM "consumer grade" is a big stretch. "Consumer ${thing}" to me is somewhere =< $3000.
- karolist 3y agoTrue, but you get a full general compute machine for under $6k, after a few years you can sell it for 3-4k and upgrade to the latest one. Personally I think it's the best thing to happen to local LLMs, by accident. I have an M1 Max 64GB and I'm blown away every day by these local models. Apple didn't plan for it, but it happened by accident due to unified memory with godzillion throughput having integrated silicon.