2 ms·
Mixtral 8x7b is better than both of those and runs on a top spec M3 Max wonderfully.
by renewiltord 3y ago
Mixtral 8x7b is better than both of those and runs on a top spec M3 Max wonderfully.
- woadwarrior01 3y agoIndeed! Also, Mixtral 8x7b runs just as well on older M1 Max and M2 Max Macs, since LLM inference is memory bandwidth bound and memory bandwidth hasn't significantly changed between M1 and M3.
- karolist 3y agoIt didn't change at all, rather was reduced in certain configurations.