To be more specific, do you regard the data AlphaGo Zero was initialized with as being relevant, quantified, and premeasured to the point that no learning occur

To be more specific, do you regard the data AlphaGo Zero was initialized with as being relevant, quantified, and premeasured to the point that no learning occurred between then and its defeat of expert players? I don't think the data they had as they learned to become experts was any less relevant, quantified, and premeasured - and quite possibly more so, if they read about tactics and strategy in the game. While I agree that nature's data is less relevant, quantified, and premeasured than what current ML feeds on, I don't see that as establishing that there is a relevant qualitative distinction that renders this divide unbridgeable in principle. Every organism that senses its environment is processing data. With regard to formulating the very terms of problems it wishes to solve, I have no difficulty in seeing that this has not been achieved yet, and personally, I don't expect it any time soon. At the same time, you seem to be very close to saying that no artificial system could do this because its goals are always, in some sense, those of its creators. To be clear, I would regard such a position as mostly avoiding the issues.