4 ms·
While direct memory access of Macs is nice, they still do have performance issues compared to a PC GPU. Of course the pricing would be entirely different with >
by raxxorraxor 2y ago
While direct memory access of Macs is nice, they still do have performance issues compared to a PC GPU. Of course the pricing would be entirely different with >128gb here. Seems like Apple is the budget solution now.
I use an adapted LLM on an old M1 macbook air and it runs very well, even for autocompleting code. Image synthesis is quite slow though, even on newer Apple chips.
Hope the moat of nvidia dies soon.
- yieldcrv 2y agoI use lower parameter LLM's on M1's with very little RAM as well. but 70B+ would be useful for me too