3 ms·
Cool, can you make it use local free models because I'm broke and can't afford AI's crazy costs.
by thedangler 11mo ago
Cool, can you make it use local free models because I'm broke and can't afford AI's crazy costs.
- Spivak 11mo agoYep, change nothing in the code in the article but spin up an Ollama server and use the OpenAI API https://docs.ollama.com/api/openai-compatibility https://docs.ollama.com/api/openai-compatibility.