These guys have done what looks like an impressive amount of work... but I was disappointed to see there's no mention of generative language modeling at all and

These guys have done what looks like an impressive amount of work... but I was disappointed to see there's no mention of generative language modeling at all and only a very brief mention of key advances in image generation over the past few years. Examples of generative language modeling ignored by this paper (not even mentioned): * Unsupervised Transformer - https://blog.openai.com/language-unsupervised/ https://blog.openai.com/language-unsupervised/ * ELMo - https://arxiv.org/abs/1802.05365 https://arxiv.org/abs/1802.05365 * ULMFit - https://arxiv.org/abs/1801.06146 https://arxiv.org/abs/1801.06146 Examples of generative image modeling ignored by this paper (some are mentioned only in passing): * Glow - https://blog.openai.com/glow/ https://blog.openai.com/glow/ * RealNVP - https://arxiv.org/abs/1605.08803 https://arxiv.org/abs/1605.08803 * NICE - https://arxiv.org/abs/1410.8516 https://arxiv.org/abs/1410.8516 * Pixel CNN - https://arxiv.org/abs/1606.05328 https://arxiv.org/abs/1606.05328 (and its cousin PixelRNN - https://arxiv.org/abs/1601.06759 https://arxiv.org/abs/1601.06759)