3 ms·
I recently set up GoModel and there's now way I'm going back to a world without it. Gateways are great for local too! I can swap out models or quants and my too
by verdverm 4mo ago
I recently set up GoModel and there's now way I'm going back to a world without it. Gateways are great for local too! I can swap out models or quants and my tools do not need to be reconfigured.
At the enterprise level, you need to be resilient to provoder downtime and gateways can handle this org wide.
- blitzar 4mo ago> Gateways are great for local too My gateway (litellm) has my local models with a fallback to the same model on openrouter. Best of both worlds.
- verdverm 4mo agoI'm not falling back to the same model, but I do have both my local llms and OpenCode Go being gateway'd, so I get a single view across all of my usage.