3 ms·
The headline is odd both because "ingesting" a few 100kb of text is a meaningless qualification as you say, and the great Gatsby is a particularly short book.
by version_five 3y ago
The headline is odd both because "ingesting" a few 100kb of text is a meaningless qualification as you say, and the great Gatsby is a particularly short book. Did they pick it on purpose because it's somehow near some length limit?
Edit: that's exactly what theh did, gg has 72k tokens according to the article (wc says the project gutenberg text has 51257 words) and the new model can do up to 75k (actually 100k tokens see below).
- famouswaffles 3y agoThe model(s) can do up to 100k tokens not 75k. But yes they picked a book that would fit.
- version_five 3y agoAh, I mixed up tokens and words (100k tokens, 75k words), the ratio of which also seems to square with the difference between the quoted number of tokens in gg and the number of words I counted.