3 ms·
Nice project, any plans to make it work with local LLMs rather than "open"AI?
by smcleod 3y ago
Nice project, any plans to make it work with local LLMs rather than "open"AI?
- ralfelfving 3y agoThanks. Had no plans, but might give it a try at some point. For me, personally, using OpenAI for this isn't an issue.
- hmottestad 3y agoI think that LM Studio has an OpenAI "compliant" API, so if there is something similar that supports vision+text then it would be easy enough to make the base URL configurable and then point it to localhost. Do you know of a simple setup that I can run locally with support for both images and text?