4 ms·

Just install ollama. And no, they're not as capable as SOTA models. Not by far. However they can help reduce your token expenditure a lot by routing them the

Just install ollama. And no, they're not as capable as SOTA models. Not by far. However they can help reduce your token expenditure a lot by routing them the low-hanging fruit. Summaries, translations, stuff like that.

ramon156 7mo ago
no need for ollama, simonw's llm tool is good enough
- wolvoleo 7mo ago
  Oh I don't know that one. I just mentioned ollama because it makes things easy for the user. But looking at it it's just an interface to the cloud LLMs? The OP's question was about local models.