You might appreciate https://slatestarcodex.com/2019/02/19/gpt-2-as-step-toward-general-intelligence/ https://slatestarcodex.com/2019/02/19/gpt-2-as-step-toward

You might appreciate https://slatestarcodex.com/2019/02/19/gpt-2-as-step-toward-general-intelligence/ https://slatestarcodex.com/2019/02/19/gpt-2-as-step-toward-g... where he compares GPT-2 to a "prediction engine" as per Andy Clark's "Surfing Uncertainty". https://slatestarcodex.com/2017/09/05/book-review-surfing-uncertainty/ https://slatestarcodex.com/2017/09/05/book-review-surfing-un... The latter suggests that the brain is a prediction engine; and things we do are just the brain minimising prediction-error for systems at various levels. (SSC is concerned about the dangers of AGI, and sees GPT-2 as imitating what people do).