4 ms·
How can anyone say that the lead is shrinking when no one still has any good competitor to strawberry? Dspy has been out for how long and how many folks have sh
by Der_Einzige 2y ago
How can anyone say that the lead is shrinking when no one still has any good competitor to strawberry? Dspy has been out for how long and how many folks have shown better reasoning models than strawberry built with literally anything else? Oh yeah, zero.
- mplewis 2y agoWow, this thing can reason now? How come it keeps getting my basic word problems wrong?
- Der_Einzige 2y agoTokenization
- youoy 2y agoIs it really a tested conclusion? Or a plausible conclusion to try to hide the limitations of the model architecture? I'm asking because I know that with some prompts it gets the answer correct, and in those cases nothing in the tokenization has changed.
- Der_Einzige 2y agoYes, this is 100% tested and proven ad nasum within the field. I have some of my own papers on this, but you can look at literally any major AI conference and find dozens of papers analyzing yet more issues caused by byte pair tokenization. Honestly the folks who don’t want to admit that it’s tokenization are just extremely salty that AI is actually good right now. Your “AI couldn’t tell me how many Rs in strawberry” stuff is extreme cope for your job prospects evaporating from a system that can’t spell correctly.
- youoy 2y agoBut does a different prompt get the answer correct? I find it surprising. Can you share a link? I'm not saying this out of saltiness, I would be very grateful. If you don't want to I will try the shitty Google search, no problem.
- tim333 2y agoIt's been out a little over a month. Give it a bit longer and everyone will have reverse engineered clones.