8 ms·
> which would usually mean "no longer directly relevant" Or it could mean the lesson from these papers has been assimilated and spread wide and far, thus they
by visarga 3y ago
> which would usually mean "no longer directly relevant"
Or it could mean the lesson from these papers has been assimilated and spread wide and far, thus they are no longer "news". The pre-layernorm is one.
- homarp 3y agoalso one of these papers is from Schmidhuber and https://news.ycombinator.com/item?id=23649542 https://news.ycombinator.com/item?id=23649542 gives some context to the "For instance, in 1991, which is about two-and-a-half decades before the original transformer paper above ("Attention Is All You Need")"