4 ms·
You just have to love Stephen Merity. His work on QRNN's saved me quite a bit of time and money when I was doing my undergrad dissertation on language models.
by 1maginary 7y ago
You just have to love Stephen Merity.
His work on QRNN's saved me quite a bit of time and money when I was doing my undergrad dissertation on language models.
This SHA-RNN seems to have surfaced from a similar line of thinking that spawned the QRNN.
- technics256 7y agoAre qRNNs still used much?
- polymorph1sm 7y agocheck out MultiFiT [0] from fastai, it uses QRNN for speed. [0] http://nlp.fast.ai/classification/2019/09/10/multifit.html http://nlp.fast.ai/classification/2019/09/10/multifit.html