1. There is a large corpus of scientific publications. 2. Thanks to scihub et al, it is possible to download them en masse. 3. It is now feasible to train goo

1. There is a large corpus of scientific publications. 2. Thanks to scihub et al, it is possible to download them en masse. 3. It is now feasible to train good language models on a large text corpus. 4. Wouldn't it be interesting to see what a model trained on this data comes up with? Maybe even new connections in existing knowledge?