3 ms·
Is it really a tested conclusion? Or a plausible conclusion to try to hide the limitations of the model architecture? I'm asking because I know that with some
by youoy 2y ago
Is it really a tested conclusion? Or a plausible conclusion to try to hide the limitations of the model architecture?
I'm asking because I know that with some prompts it gets the answer correct, and in those cases nothing in the tokenization has changed.
- Der_Einzige 2y agoYes, this is 100% tested and proven ad nasum within the field. I have some of my own papers on this, but you can look at literally any major AI conference and find dozens of papers analyzing yet more issues caused by byte pair tokenization. Honestly the folks who don’t want to admit that it’s tokenization are just extremely salty that AI is actually good right now. Your “AI couldn’t tell me how many Rs in strawberry” stuff is extreme cope for your job prospects evaporating from a system that can’t spell correctly.
- youoy 2y agoBut does a different prompt get the answer correct? I find it surprising. Can you share a link? I'm not saying this out of saltiness, I would be very grateful. If you don't want to I will try the shitty Google search, no problem.