> GPT-3 is already composing halfway-credible poetry and songs. Poetry and songs abound in its training data. > I just asked it to write some code to walk a k

> GPT-3 is already composing halfway-credible poetry and songs. Poetry and songs abound in its training data. > I just asked it to write some code to walk a k-d tree, and it did that, too, complete with a unit test. Such things abound in its training data. GPT-3 can't produce anything novel. It's a search engine over natural generalisations of its training data, but it can't think for itself. It couldn't solve any of the unsolved problems of our day. Give it a maths problem with a known solution, and it might give you a half-way decent proof. Give it a problem without a known solution – even an easier one – and it'll flounder.