4 ms·
an extension seems the most natural way to do this, but that would entail hosting a model which isn't cheap, will give it a go
by pratik_kanthi 2y ago
an extension seems the most natural way to do this, but that would entail hosting a model which isn't cheap, will give it a go
- IncreasePosts 2y agoCan extensions connect to localhost? IE to a local ollama for example.
- kilroy123 2y ago[dead]
- pratik_kanthi 2y agoYes they can. But the ergonomics of that aren't great. Also ollama takes up a sigificant amount of memory. I'm trying this with a cheap model like phi-3 hosted on my server.