> [...] are they just very inefficient in how they learn? I'd challenge: inefficient compared to what? For many tasks, the only more capable systems we know of

> [...] are they just very inefficient in how they learn? I'd challenge: inefficient compared to what? For many tasks, the only more capable systems we know of are biological ones that evolved on 4 billion years' worth of data followed by years of constant input from all senses. Gradient descent is incredibly fast and data-efficient by comparison (hence use of mutation + natural selection for machine learning is mostly limtied to tiny toy examples).