4 ms·Just a guess as I'm not OP, but 2017 is when the "Attention Is All You Need" paper was published.by gorbypark 3y agoJust a guess as I'm not OP, but 2017 is when the "Attention Is All You Need" paper was published.