3 ms·
“By continuing you agree to allow Inbox Zero to send your emails to OpenAI for processing.” Yeah, unfortunately this kills it for me. Handing my whole personal
by bytethis 3y ago
“By continuing you agree to allow Inbox Zero to send your emails to OpenAI for processing.”
Yeah, unfortunately this kills it for me. Handing my whole personal inbox over to OpenAI seems insane.
- viraptor 3y agoI'm not sure if that's already exposed as an option, but if you're happy to run this app locally, then LiteLlm exposes local models using the OpenAI API. That means you only need to change the endpoint, tell LiteLlm to use for example Mistral and it should "just work". Even if not implemented yet, it would be a trivial change.
- wise_young_man 3y ago> It would be a trivial change. My favorite line in the tech industry.
- rolisz 3y agoTrivial change, except for also having to change all the prompts to work well with Mistral. LLMs are not equal, you have to ask each one "nicely" in a different way.
- viraptor 3y agoYou can change the prompts if you want better results. But you don't have to do it. I've replaced GPT endpoint with LiteLlm a few times already and had to adjust the prompt only once. If I can't see the difference, why bother?
- elieskilled 3y agoThe project uses the ai npm package from Vercel which does interface with a lot of different LLMs. But I imagine there is a little work for it to just work with any provider. I think it would be really cool to get it running with something like Mistral in the browser: https://webllm.mlc.ai/ https://webllm.mlc.ai/
- elieskilled 3y agoWeb LLM looks promising: https://webllm.mlc.ai/ https://webllm.mlc.ai/ And I hope we can offer this as an option with Mistral in the coming months.