I was thinking specifically of all the amazing work that has been done since the Attention is All You Need paper from 2018. There’s been a lot of progress in ju

I was thinking specifically of all the amazing work that has been done since the Attention is All You Need paper from 2018. There’s been a lot of progress in just the past 5 years.