2 ms·Yes. A stronger test would be guessing the results of as-yet-unpublished experiments.by a123b456c 2y agoYes. A stronger test would be guessing the results of as-yet-unpublished experiments.jslezak 2y agoThey did this. Read the paperabcgde 2y agoWell, they looked at papers that weren't published as of the original model release. But GPT very likely had unannounced model updates. Is it not possible that many of the post 2021 papers were in the version of GPT they actually worked with?