4 ms·
This seems pretty similar to the Longformer, and the performance is not that much better. Is the only difference the random attention?
by codekansas 6y ago
This seems pretty similar to the Longformer, and the performance is not that much better. Is the only difference the random attention?