2 ms·
Running and storing 3M LLM AI requests without spending $100k
- whinvik 1y agoI increasingly think that as people use AI more and more as part of their workflows, they will realize it makes more sense to use self hosted models. Open models will probably never be as good as the priced models so they will not always be useful. But I think at the scale we will be using AI models eventually, using API's will stop making sense.