3 ms·
Its root cause is that tokenization is per spelled word. ChatGPT has no ability to differentiate homonyms. It can "understand" them based on the context, but th
by mminer237 3y ago
Its root cause is that tokenization is per spelled word. ChatGPT has no ability to differentiate homonyms. It can "understand" them based on the context, but there's always some confusion bleeding through.