4 ms·
I completely agree — open-source models and custom deployments just can't compete with the cost and efficiency here. The only exception here is if open-source m
by vsreekanti 3y ago
I completely agree — open-source models and custom deployments just can't compete with the cost and efficiency here. The only exception here is if open-source models can get way smaller and faster than they are now while maintaining existing quality. That will make private deployments and custom fine-tuning way more likely.
- SkyMarshal 3y agoOr FOSS models remain the same size and speed, but hardware for running them, especially locally, steadily improves till the AI is "good enough" for a large enough segment of the market.