3 ms·

Ollama [0] + LiteLLM [1] [0] https://ollama.ai https://ollama.ai [1] https://github.com/jmorganca/ollama/issues/305#issuecomment-1751848077 https://github.com

by all2 3y ago

Ollama [0] + LiteLLM [1] [0] https://ollama.ai https://ollama.ai [1] https://github.com/jmorganca/ollama/issues/305#issuecomment-1751848077 https://github.com/jmorganca/ollama/issues/305#issuecomment-... --- Ollama is essentially docker for LLMs, and LiteLLM offers an API passthrough to make Ollama OpenAI API compatible. I haven't tried it yet, but I will be trying it probably this weekend.

replwoacause 3y ago
Cool! Is it possible to make this self-hosted model reference my own content, for example markdown files? Or does it only know how to respond to things it was trained on?