5 ms·
To the extent it’s measurable, LLMs are becoming more creative as the models improve. I think it’s a bold statement to say they’ll NEVER be creative. Once again
by pythonguython 1y ago
To the extent it’s measurable, LLMs are becoming more creative as the models improve. I think it’s a bold statement to say they’ll NEVER be creative. Once again, we’ll have to see. Creativity very well could be emergent from training on large datasets. But also it might not be. I recommend not speaking in such absolutes about a technology that is improving every day.
- pclmulqdq 1y ago"To the extent it's measurable" is very load-bearing in the semantics here. A lot of "creativity" is very hard to measure.
- pythonguython 1y agoI agree, and I think most people would say the current models would rank low on creativity metrics however we define them. But to the main point, I don’t see how the quality we call creativity is unique to biological computing machines vs electronic computing machines. Maybe one day we’ll conclusively declare creativity to be a human trait only, but in 2025 that is not a closed question - however it is measured.
- Jensson 1y agoWe were talking about LLM here, not computing machines in general. LLM are trained to mimic not to produce novel things, so a person can easily think LLM wont get creative even though some computer program in the future could.
- signatoremo 1y ago> LLM are trained to mimic not to produce novel things Which LLM? That’s not the purpose of training for any model that I know of.
- namaria 1y agoTraining LLMs is literally finding sets of numbers that make them better at mimicking human language.
- codr7 1y agoDifficult to measure, but trivial to define. Creativity means play, as in not following rules, adding something of yourself. Something a computer just can't do.