3 ms·
I wonder if these are tokenization issues? I really am curious about metas byte tokenization scheme...
by spacemanspiff01 2y ago
I wonder if these are tokenization issues? I really am curious about metas byte tokenization scheme...
- jampekka 2y agoProbably mostly not. The errors tend to be logical/conceptual. E.g. mixing up scalars and matrices is unlikely to be from tokenization. Especially if using spaces between the variables and operators, as AFAIK GPTs don't form tokens over spaces (although tokens may start or end with them).