I'm somewhat glad that the creators have the foresight to blacklist words such as "eugenics" since obviously there's a risk that such AI-generated papers would

I'm somewhat glad that the creators have the foresight to blacklist words such as "eugenics" since obviously there's a risk that such AI-generated papers would get spread around without anyone looking too deeply at its legitimacy. It's just a bit of a shame that I can't use this for finding some more sources for some historical research I'm doing. "Prove the Riemann hypothesis" was an unsurprising failure. However, disappointingly the language model didn't even attempt a proof at all, instead just doing a disambiguation type page of what it could refer to. Same goes for asking for a few other proofs. It does seem to "know" several algorithm runtimes, but asking "What is the runtime of the clique problem solving algorithm" gives O(n^2) which would be big if true. Asking the algorithm "Who invented the TeX system" gives the correct answer of Don Knuth, though asking "Who invented the freeze ray" gives Nikola Tesla for some reason. Finally, a few gene related questions caused it to fail. Asking for "What genes are involved in mechanosensing in T cells" gives a number of CD* genes, many not expressed in T cells (I hazard here that what's happening is the algorithm is just entering something of a loop state like a few other language models I've seen, where it fails to terminate since the previous few words are similar enough for it to just continue the sequence). Asking "What genes are involved in mechanosensing" is simply answered with "Yes".