4 ms·
Open weights/source doesn't necessarily mean running on local hardware, though. I imagine having multiple providers competing will drive down hosted versions o
by Chu4eeno 4mo ago
Open weights/source doesn't necessarily mean running on local hardware, though.
I imagine having multiple providers competing will drive down hosted versions of open weight models drastically.
- Tuna-Fish 4mo agoYou are describing OpenRouter. And yes, it does.
- Chu4eeno 4mo agoWell, open router is a bit more general, since it just proxies requests to both proprietary and open weights models. I was thinking more of the providers of inference on open weight models that openrouter proxies to.
- mncharity 4mo ago> Open weights/source doesn't necessarily mean running on local hardware, though. And we've barely started to scratch the surface on helping open-weight models "be the best they can be", with cloud burst parallel sampling and prompt mutation. Looking for best probabilistic results for a prompt, and looking for best prompt variants for a task. Adaptively scaling computes at generation, not just training. And speculatively, if agentic coding is naturally a multiplicity, what UX might enable human devs to dance with that quantum superposition? Rather than quickly collapsing to one monkey and its keyboard.