3 ms·
You can change the prompts if you want better results. But you don't have to do it. I've replaced GPT endpoint with LiteLlm a few times already and had to adjus
by viraptor 3y ago
You can change the prompts if you want better results. But you don't have to do it. I've replaced GPT endpoint with LiteLlm a few times already and had to adjust the prompt only once. If I can't see the difference, why bother?
- elieskilled 3y agoThe project uses the ai npm package from Vercel which does interface with a lot of different LLMs. But I imagine there is a little work for it to just work with any provider. I think it would be really cool to get it running with something like Mistral in the browser: https://webllm.mlc.ai/ https://webllm.mlc.ai/