3 ms·
Do you sincerely think the folks training these models haven't tried alternative tokenizations?
by doctorpangloss 2y ago
Do you sincerely think the folks training these models haven't tried alternative tokenizations?
- Scarblac 2y agoOf course they have, I assume counting letters in words wasn't a priority for them.