4 ms·
The good old "kilogram of steel" test is something that the children, the mentally infirm and the less capable LLMs all fail in the same way. Some failures lik
by ACCount37 10mo ago
The good old "kilogram of steel" test is something that the children, the mentally infirm and the less capable LLMs all fail in the same way.
Some failures like that are simply human failures reproduced faithfully. Some are rooted deeper than that.
And yes, it's true that children don't get bored in the same way adults do, which often leads to repetitive behavior. Boredom is an important heuristic for behavior, it seems.
- IshKebab 10mo ago> repetitive behavior I mean literally saying the same thing again and again. Like "And then I played and then I played and then I played and then I played..."
- ACCount37 10mo agoYes, including that. It's just the small version of the thing LLMs are prone to. A lot of LLM behaviors are self-reinforcing across context, and this includes small stupid loops and the more elaborate variants. Like an LLM making a reasoning mistake, catching it while checking itself, and then making it again, 5 times in a row.