4 ms·
Agreed with much of this. Models are commodities. LLM gateways are the correct enterprise pattern imo.
by _superposition_ 3mo ago
Agreed with much of this. Models are commodities. LLM gateways are the correct enterprise pattern imo.
- deleted 3mo ago[deleted]
- verdverm 3mo agoI recently set up GoModel and there's now way I'm going back to a world without it. Gateways are great for local too! I can swap out models or quants and my tools do not need to be reconfigured. At the enterprise level, you need to be resilient to provoder downtime and gateways can handle this org wide.
- blitzar 3mo ago> Gateways are great for local too My gateway (litellm) has my local models with a fallback to the same model on openrouter. Best of both worlds.
- verdverm 3mo agoI'm not falling back to the same model, but I do have both my local llms and OpenCode Go being gateway'd, so I get a single view across all of my usage.