3 ms·
The breakthrough is not that they are the first to use AE for text. It is that they are the first to eliminate the bottleneck that prevented AEs to beat transfo
by The_rationalist 6y ago
The breakthrough is not that they are the first to use AE for text. It is that they are the first to eliminate the bottleneck that prevented AEs to beat transformers.
You linked paper seems interesting on paper but does it bring any new SOTA?
- p1esk 6y agoAEs to beat transformers Can you point me to some example of generated text this model produced? Something similar in quality to that unicorn story from GPT-2? but does it bring any new SOTA? Looking at their tables, seems so. The code is open source, and there's demo at https://mosaickg.apps.allenai.org/ https://mosaickg.apps.allenai.org/