2 ms·
I use 27B in plan mode and 35B MoE in act mode. I noticed that is the best balance for me for consistent tool calls and intelligent planning. Takes some time to
by wickedsight 2mo ago
I use 27B in plan mode and 35B MoE in act mode. I noticed that is the best balance for me for consistent tool calls and intelligent planning. Takes some time to switch, but it's worth it for me.
- julianlam 2mo agoWonder if it's possible to share a common cache via cachyllama between 27B and 35B-A3B