Many of the examples are things that a feedforward model like GPT-4 has plenty of capacity for, could do (eg all the real-world facts), and each example helps i

Many of the examples are things that a feedforward model like GPT-4 has plenty of capacity for, could do (eg all the real-world facts), and each example helps induce the transition between memorization and generalization so it will do. In some cases like multiplying large numbers, it can't no matter how many examples it's given (with a realistic number, anyway) - but every query firms up the ability to swap out Wolfram Alpha for any other calculator... Wolfram is playing with fire here (https://gwern.net/complement https://gwern.net/complement) given that the output is going to, one way or another, assist training future AI models.