In their Transformer section they have implementations of: - kNN-LM: Generalization through Memorization - Feedback Transformer - Switch Transformer

In their Transformer section they have implementations of: - kNN-LM: Generalization through Memorization - Feedback Transformer - Switch Transformer Which are all from recent, highly interesting papers