4 ms·
I think everyone running LLaMA on "cheap" Macs are using this: https://news.ycombinator.com/item?id=35100086 https://news.ycombinator.com/item?id=35100086 I've
by hnfong 4y ago
I think everyone running LLaMA on "cheap" Macs are using this: https://news.ycombinator.com/item?id=35100086 https://news.ycombinator.com/item?id=35100086
I've had success running the 7B model on a 16GB M1 Mac Mini (purchased in 2020!). I didn't bother to try but pretty sure the 13B model works as well.
I suspect you could grab one of those for less than $1000 these days.