3 ms·
That's high enough for most users, I reckon.
by ukuina 3y ago
That's high enough for most users, I reckon.
- zoogeny 3y ago40k tokens per minute is enough for most users is the next "640K ought to be enough for anybody"
- tornato7 3y agoIndeed, if context lengths grow to millions of tokens, and prices are cheap enough, I could see users feeding their entire codebase in to ask a simple question about it - or feed in every email from their inbox to find something specific they're looking for, or use as style/content guides to write a response.