5 ms·
Creativity is the one area where LLMs are completely unimpressive. They only spit out derivative works of what they’ve been trained on. I’ve never seen an LLM t
by hbn 2y ago
Creativity is the one area where LLMs are completely unimpressive. They only spit out derivative works of what they’ve been trained on. I’ve never seen an LLM tell a good joke, or an interesting story. It doesn’t know how to subvert expectations, come up with clever twists, etc. they just pump out a refined average of what’s typical.
- rationalfaith 2y ago[dead]
- basch 2y agothey also struggle to know when to break the rules of english, make up words, introduce pun, bounce between tones, write with subtext, introduce absurdity, allude to other ideas etc. I'd say its less the work they have been trained on, and more what they have been reenforced to do, which is stay on topic. it causes them to dwell instead of drift.
- shadowmanif 2y agoClaude can make some interesting guitar tabs if you prompt it to transcribe an instrument/music that wouldn't normally be something a rock guitar player would be influenced by. It is like saying the paint brush and canvas lack creativity. Creativity is not a property of the tool, it is a property of the artist. We also have a very poor understanding of human creativity from selection bias. Last weekend I found a book at the library that was Picasso's drawings 1966 to 1968. There must have been 1000-1500 drawings in this book. Many were just half finished scribbles. The average person seems to believe though that the master artist only produces masterpieces because they didn't bother to look at all the crap.
- brookst 2y ago> They only spit out derivative works of what they’ve been trained on How is that different from humans? Do we get magic inspiration totally separate from anything we’ve learned? Show me any great book, song, movie, building, sculpture, painting. I will tell you the influences the artist trained on.
- suddenlybananas 2y agoHumans are obviously influenced by others but we can also invent novel things that didn't exist before. LLMs trained on the outputs of LLMs collapse into gobbledygook whereas humans trained on humans build civilisation.
- brookst 2y agoHumans trained on human output also build death cults and other harms. And humans believe that nonsense. I’m not sure “can produce good outputs, can produce terrible outputs” is a good way to differentiate humans and LLMs.
- digging 2y agoThey're different because they're trying to find the most likely output, and humans usually. You can ask and LLM to make weird combinations and use unusual framings, but it's only going to do so once you've already come up with that.
- brookst 2y agoI asked ChatGPT “ Write a one paragraph pitch for a novel that combines genres and concepts in a way that’s never been done before.” I’m not going to claim this is Pulitzer-worthy, but it seems fairly novel: > In Spiritfall: A Symphony of Rust and Rose Petals, readers traverse the borders of time, taste, and consciousness in a genre-bending epic that effortlessly fuses neo-noir detective intrigue, culinary magic realism, and post-biotechnological body horror under the simmering threat of a cosmic opera. Set in a floating, living city grown from engineered coral-harps, the story follows a taste-shaper detective tasked with unraveling the murder of an exiled goddess whose voice once controlled the city’s very tides. As he navigates sentient cooking knives, ink-washed memory fractals, and teahouses that serve liquid soul fragments, he uncovers conspiracies binding interdimensional dream-chefs to cybernetic shamans, and finds forbidden love in a quantum greenhouse of sentient spices. Every chapter refracts expectations, weaving together genres never before dared, leaving readers both spellbound and strangely hungry for more.