3 ms·
Hey! That's a very interesting explanation, could you please provide any references for further/detailed reading on model's abilities to learn to add numbers, w
by LakshyAAAgrawal 4y ago
Hey! That's a very interesting explanation, could you please provide any references for further/detailed reading on model's abilities to learn to add numbers, with carry and finally with carry across digits?
- spion 4y agoThere is some commentary in the GPT-3 paper https://arxiv.org/pdf/2005.14165.pdf https://arxiv.org/pdf/2005.14165.pdf (figure 3.10 and table 3.10) note: I may have extrapolated a bit more than strictly correct from those two bits, but the accuracy being about 50% indicates carrying is the issue. GPT-3 is at around carrying twice, but hasn't generalized full carrying yet.