> I assume it can't even reliably solve basic algebra that isn't found in the dataset. ::sigh:: It can, even though there are specific technical reasons that w

> I assume it can't even reliably solve basic algebra that isn't found in the dataset. ::sigh:: It can, even though there are specific technical reasons that working with both numbers and exact answers is hard for it. (The way the input text is encoded combines digits in an inconsistent and formatting specific way, and the way text is generated isn't just to take the models most likely output but to randomly sample among the top couple most likely outputs, which is an obvious handicap when there is a single right answer.) https://pbs.twimg.com/media/EdHuMgsWsAEk-29?format=png&name=large https://pbs.twimg.com/media/EdHuMgsWsAEk-29?format=png&name=... https://pbs.twimg.com/media/EdII5jhXkAA8eKv?format=png&name=medium https://pbs.twimg.com/media/EdII5jhXkAA8eKv?format=png&name=... (lines starting with > are the human)