3 ms·
well, and straight caching. If they know that 80% of people ask the same 10,000 questions without a back and forth dialogue, it's not hard to just write a fron
by VirusNewbie 3y ago
well, and straight caching. If they know that 80% of people ask the same 10,000 questions without a back and forth dialogue, it's not hard to just write a front end for that.
- vineyardmike 3y agoThis problem won’t work for code assistants. No way those queries have high repetition. Not when you’re uploading user files. I assume the best strategy is to shrink the models and tune them more.