3 ms·
40k tokens per minute is enough for most users is the next "640K ought to be enough for anybody"
by zoogeny 3y ago
40k tokens per minute is enough for most users is the next "640K ought to be enough for anybody"
- tornato7 3y agoIndeed, if context lengths grow to millions of tokens, and prices are cheap enough, I could see users feeding their entire codebase in to ask a simple question about it - or feed in every email from their inbox to find something specific they're looking for, or use as style/content guides to write a response.