4 ms·
They just need to keep it going until GPUs get cheaper. The point is to build/protect the monopoly until that happens. Then costs come down and they start pri
by treis 3y ago
They just need to keep it going until GPUs get cheaper. The point is to build/protect the monopoly until that happens. Then costs come down and they start printing an absurd amount of money.
- VirusNewbie 3y agowell, and straight caching. If they know that 80% of people ask the same 10,000 questions without a back and forth dialogue, it's not hard to just write a front end for that.
- vineyardmike 3y agoThis problem won’t work for code assistants. No way those queries have high repetition. Not when you’re uploading user files. I assume the best strategy is to shrink the models and tune them more.
- outside1234 3y agoThe problem is that they don't have a monopoly. Not hard to see how CodeLlama and other future open source models can't stand-in here for GPT-4 at dramatically lower cost.