Prior is in some sense the fruit of data. Humans develop prior by accumulating experiences. Laws of physics are discovered through experimentation and introspe

Prior is in some sense the fruit of data. Humans develop prior by accumulating experiences. Laws of physics are discovered through experimentation and introspection over many data points. So what we really need is a life-long learner - a machine learning algorithm that could extract knowledge from many tasks and store that in its long-term memory. The fact that we don't have an architecture for long-term memory is the main road blocker towards this goal.