6 ms·
Is there any product that allows me to plug in my own Open source LLM and run it locally?
by abhyantrika 2y ago
Is there any product that allows me to plug in my own Open source LLM and run it locally?
- Havoc 2y agoYep. Continue.dev with ollama. Works but the suggests tend to be short. Like a smart auto complete Needs a gpu though not a big vram one given that using smaller models for this is better due to speed
- btzs 2y agoTabby.ml also works well
- SmellTheGlove 2y agoRubber duck does.