4 ms·
I don't need a million tokens, but 8k is absolutely too few for many of the use cases that I find important. YMMV.
by mrtranscendence 2y ago
I don't need a million tokens, but 8k is absolutely too few for many of the use cases that I find important. YMMV.
- anoncareer0212 2y agoI don't think it's a YMMV thing: no one claims it is useless, in fact, there's several specific examples of it being necessary.