The authors reached this conclusion after finetuning a GPT-3 model, i.e., they tinkered with the weights, and they used an old model. This begs a lot of questi

The authors reached this conclusion after finetuning a GPT-3 model, i.e., they tinkered with the weights, and they used an old model. This begs a lot of questions: Why did they use an old model? Why finetune? Why not run these experiments on an untouched model? How does a model untouched by the authors perform? Did they check to make sure they didn't inadvertently induce catastrophic forgetting while messing up with the weights? Did they use common prompting techniques (e.g., chain-of-thought)? (Doesn't look like it.) If you run the same prompts on an untouched GPT-4, how does it perform?