4 ms·
It's not the open models that suck, it's the infrastructure around them. None of current "open weights providers" have: - good tools for agentic workflows
by rglullis 11mo ago
It's not the open models that suck, it's the infrastructure around them. None of current "open weights providers" have:
- good tools for agentic workflows
- no tools for context management
- infrastructure for input token caching
These are solvable without having to pay anything to OpenAI/Anthropic/Google.
- threeducks 11mo agoWhy would the open weights providers need their own tools for agentic workflows when you can just plug their OpenAI-compatible API URL into existing tools? Also, there are many providers of open source models with caching (Moonshot AI, Groq, DeepSeek, FireWorks AI, MiniMax): https://openrouter.ai/docs/guides/best-practices/prompt-caching https://openrouter.ai/docs/guides/best-practices/prompt-cach...
- rglullis 11mo ago> when you can just plug their OpenAI-compatible API URL into existing tools? Only the self-hosting diehards will bother with that. Those that want to compete with Claude Code, Gemini CLI, Codex et caterva will have to provide the whole package and do it a price point that is competitive even with low volumes - which is hard to do because the big LLM providers are all subsidizing their offerings.