16 ms·
You're right.If a format is easy to grep, it is almost always cheap to tokenize. We treat token density as a primary design constraint.
by tsazan 9mo ago
You're right.If a format is easy to grep, it is almost always cheap to tokenize. We treat token density as a primary design constraint.