I don't know that the benchmarks capture the subjective difference in GPT-2 and GPT-3. It's much better. I really feel like the lack of explainability is prev

I don't know that the benchmarks capture the subjective difference in GPT-2 and GPT-3. It's much better. I really feel like the lack of explainability is preventing us from understanding how to compose prompts to achieve the best outcome. There are subtle input differences (including whitespace) that result in large differences in output.