It's entirely pedagogical. For many of us, attempting to understand how a specific training system works can be obscured by the complexity of the implementatio

It's entirely pedagogical. For many of us, attempting to understand how a specific training system works can be obscured by the complexity of the implementation. This is something you can put in front of smart college students and they can read all the code, appreciate the bits that required some brain surgery, and then understand GPT-2 as an instance of transformers, then go on to use a real framework proficiently with a better understanding of what the framework is doing under the hood.