Reformer NLP model uses LSH to reduce the size of the transformer/attention layer while keeping the same accuracy, being able to model much longer context lengt

Reformer NLP model uses LSH to reduce the size of the transformer/attention layer while keeping the same accuracy, being able to model much longer context lengths in NLP or do image/video generation: https://ai.googleblog.com/2020/01/reformer-efficient-transformer.html https://ai.googleblog.com/2020/01/reformer-efficient-transfo...