There is some commentary in the GPT-3 paper https://arxiv.org/pdf/2005.14165.pdf https://arxiv.org/pdf/2005.14165.pdf (figure 3.10 and table 3.10) note: I may

There is some commentary in the GPT-3 paper https://arxiv.org/pdf/2005.14165.pdf https://arxiv.org/pdf/2005.14165.pdf (figure 3.10 and table 3.10) note: I may have extrapolated a bit more than strictly correct from those two bits, but the accuracy being about 50% indicates carrying is the issue. GPT-3 is at around carrying twice, but hasn't generalized full carrying yet.