4 ms·
Sure, I have a 64G MBP with an M1 Ultra. The best model for me by far has been the 35B A3B, in particular the 8Q_KL unslouth variant. The dense model works but
by regexorcist 5mo ago
Sure, I have a 64G MBP with an M1 Ultra. The best model for me by far has been the 35B A3B, in particular the 8Q_KL unslouth variant. The dense model works but it's much slower, and I don't really see a difference in quality with a good harness.
- koyote 5mo agoWhat do you use as a harness?
- bobim 5mo agoThis is also of interest!
- regexorcist 5mo agoI use oh-my-openagent. It does an incredible job at planning and executing by orchestrating subagents with different roles.