3 ms·
Given that any self hosted open source model would have worked just as well. I can’t see this good faith post as anything more than forwarding open ais long cam
by commandpaul 2y ago
Given that any self hosted open source model would have worked just as well. I can’t see this good faith post as anything more than forwarding open ais long campaign for regulatory capture.
- dtquad 2y agoSelf-hosting LLMs is expensive at scale. It's cheaper to use VC subsidized model inference like the OpenAI APIs.
- CyberDildonics 2y agoAt "scale"? At what scale?
- littlestymaar 2y agoThere are plenty of VC-subsidized inference provider which uses open source LLM for much cheaper than OpenAI (which isn't really VC-subsidized at this point but Microsoft-subsidized).
- refulgentis 2y agoMy anecdata is most teams I've talked to say its below OpenAI at scale, and vLLM is a beast. It's interesting to hear the opposite, there's lots of cheaper providers, but the "VC dollars" argument can go "turtles all the way down", I suppose. Still, reality seems to differ.
- deleted 2y ago[deleted]