4 ms·
What tool are you using to enable switching between so many models?
by kristianp 1y ago
What tool are you using to enable switching between so many models?
- RamtinJ95 1y agoSomething like opencode probably, that’s what I have been using to freely and very easily switch between models and keep all my same workflows. It’s phenomenal really
- KronisLV 1y agoFor local chat Jan seems okay, or OpenWebUI for something hosted. For IDE integrations some people enjoy Cline a bunch but RooCode also allows you to have multiple roles (like ask/code/debug/architect with different permissions e.g. no file changes with ask) and also preconfigured profiles for the various providers and models, so you can switch with a dropdown, even in the middle of a chat. There’s also an Orchestrator mode so I can use something smart for splitting up tasks into smaller chunks and a dumber but cheaper model for the execution. Aside from that, most of the APIs there seem OpenAI conformant so switching isn’t that conceptually difficult. Also if you wanna try a lot of different models you can try OpenRouter.
- lolive 1y agoIsn't Continue supposed to help you do that, in VSCode? https://marketplace.visualstudio.com/items?itemName=Continue.continue https://marketplace.visualstudio.com/items?itemName=Continue...
- dhumph 1y agoCline & Open router
- kanzure 1y agoYou can also switch between models with aider https://aider.chat/ https://aider.chat/
- thebigspacefuck 1y agoAider hasn’t been updated much lately, seems to be dying
- leoalho 1y agoOctofy (https://octofy.ai https://octofy.ai), it also allows answering with multiple models for one prompt.
- neurostimulant 1y agoZed is actually pretty good at this.