The main difference between ML in its current state and biological systems is the huge compute/energy asymmetry between training and inference. Biological syste

The main difference between ML in its current state and biological systems is the huge compute/energy asymmetry between training and inference. Biological systems have it too, but it's much less prominent, as they have neuroplasticity which allows them to learn on the fly. I guess the context window can be considered a (poor) substitute for the missing neuroplasticity, but it's really limited in what it can do.