3 ms·
I think the hard part with these ai models is it’s kind of hard to figure out how many tokens you’re going to use, especially as a new user. 4,000 tokens sounds
by vertoc 1y ago
I think the hard part with these ai models is it’s kind of hard to figure out how many tokens you’re going to use, especially as a new user. 4,000 tokens sounds like a lot for instance, but is tiny
- fuzzzerd 1y agoWhile I don't disagree that determining usage is incredibly difficult, it doesn't take a genius to see that something sold "by the million" is something you can expect to to use a lot of.
- thimabi 1y agoIf companies offered any sort of counter, users would quickly understand their usage patterns and adapt accordingly. But users are kept in the dark on purpose, often not knowing how many tokens they use, and sometimes not even knowing what are the token limits.