3 ms·
i would love to see how to build one that uses open source models instead of anthropic or openai
by vivzkestrel 3mo ago
i would love to see how to build one that uses open source models instead of anthropic or openai
- lukasco 3mo agoDo you mean using open source models via something like OpenRouter, or do you mean self-hosting the models? That self-hosting bit is definitely something I'm interested in, but it still seems very fiddly (in general). I've had good results just plugging in models into Claude Code, however (though not self-hosted).
- vivzkestrel 3mo ago- well to be honest i was gonna say something like lm-studio but yea self hosting counts - basically anything that is not frontier lab