4 ms·
Replying to my own comment - it's trivially possible to replace `api_base` in settings.yaml. The only problem is that Ollama doesn't support OpenAI style embedd
by piotrrojek 2y ago
Replying to my own comment - it's trivially possible to replace `api_base` in settings.yaml. The only problem is that Ollama doesn't support OpenAI style embedding endpoint yet. But looking through PRs to Ollama, this is very close to being merged.
All steps before actual embedding work fine with e.g. Llama3-8B.
- goofystasy 2y agoYou can use litellm with drop_params for embedding endpoint