> Why does it need 100x the dataset? Sentient creatures, including humans, manage to figure stuff out from as little as a single data point. Because machine tr

> Why does it need 100x the dataset? Sentient creatures, including humans, manage to figure stuff out from as little as a single data point. Because machine training doesn't involve embodiment and sensory information. Humans can extrapolate information from seeing a single image because we are "trained" from birth by being a physical actor in this world. We know what bread looks like, what's mustard is, what a sausage is. We have information about size, texture, weight... all sorts of physical guesses that would help us pick the right tool for the job. Machine training only relies on the coherent information we gave it to them, but that data also represents something we've created by experiencing the world through our bodies. So giving them more data can increase the model precision, I'd assume. It's also a kind of shortcut to intelligence, since we don't have to wait years/decades to make these models do some useful work.