3 ms·
I would expect to see LLMs that are creative in math before any that are creative in writing. Creativity is more easily specified in math and the solutions can
by jetrink 2mo ago
I would expect to see LLMs that are creative in math before any that are creative in writing. Creativity is more easily specified in math and the solutions can be formally verified. There's no good way to classify creative writing. Many truly great works are overlooked by experts and the public until decades later. Many derivative works are commercially successful.
- zarzavat 2mo agoLLMs, both in writing and mathematics seem to only be capable of coming up with texts that are inside the distribution of the training data. With writing it's just more obvious. LLMs don't write with personality. They don't create new and exciting worlds on their own. Everything they output feels derivative. In mathematics you see the same effect. They are very good at finding results that humans missed, taking advantage of their broad knowledge and tireless work ethic. But just as they have been unable to create new literary worlds, they also have so far been unable to create new mathematics. I believe this lack of creativity is intrinsic to how these models are architected and trained. We want models that produce these in-distribution outputs because those types of models are more economically valuable. Nobody wants a coding agent with spontaneity, we want models that predictably and obediently solve problems - and that's what we got.
- deleted 2mo ago[deleted]
- goekjclo 2mo agoMan the cope on HN is something else. Neighbour, 99.9(9)% of professional mathematicians don't go around creating new mathematics. The goalposts have been moved so far that we're now at "AI isn't Grothendieck yet".
- polanyer 2mo agoNot to mention it is all subjective taste. There is nothing objective beyond consensus that a "great" work of creative writing is "great" no matter how great a consensus thinks it is. It is really the same with any art form.