3 ms·
Are commentors even reading the article or just bitching about how GPT-2 sucks or pedantry of LoC metrics? Look at this article a different way. The author pu
by neomantra 2y ago
Are commentors even reading the article or just bitching about how GPT-2 sucks or pedantry of LoC metrics?
Look at this article a different way. The author put a lot of information in a small context window so that it easier for readers to understand transformers. They included a useful code highlighter to ground it.
To soooo many people, even those with strong math/science, GPT is magic. This article opens the spell book, lays it out as a computation graph with all the fixing’s. The code isn’t abominable especially when paired with the prose.
It is a good piece of education and I will also call it art.
- FrustratedMonky 2y agoAlso, demistifying the 'complexity'. I see so many articles saying, or assuming, that 'those software people know what is happening', because it is programmed. I hear 'well they programmed it, so they know what is going on right?'. This is pretty clearly showing, look it isn't a lot of code, and look what happens. Even if GPT2 isn't all that great, look at the amount of code, it is small, not some pile of millions of lines of complex programming to make it work.
- deleted 2y ago[deleted]