Yeah GPT-4, the current Sota isn't generally professional/expert level in most domains so this isn't exactly surprising revelation even if true. This paper als

Yeah GPT-4, the current Sota isn't generally professional/expert level in most domains so this isn't exactly surprising revelation even if true. This paper also suffers from the "single pass problem". LLMs aren't that new anymore. Most researchers should know that whatever you get on a single pass can be/is often much lower quality than if taking the effort to be more specific, provide examples or breaking the task down and going through multiple passes. From my experience getting several LLMs to write, this doesn't hold any less true in the domain of creative writing so there's a very good chance this paper severely underestimates the potential of even current LLMs.