3 ms·
I built a router that lets you route between local and cloud models. Link in my profile.
by try-working 1mo ago
I built a router that lets you route between local and cloud models. Link in my profile.
- embedding-shape 1mo agoYeah, I also built my own "router" for this: if (process.env.LOCAL_MODEL { http('localhost:3000/v1/completions')... } else { http('api.openrouter.ai/v1/completions')... }
- nvme0n1p1 1mo agoBrilliant! I'd like to invest $10M. Who should I make the check out to?