3 ms·
If you ask me "What is 2+2" and I say "umbrella", that's not creativity. If I'm an LLM model and alignment and fine tuning restricts my answers to "4", I've no
by malfist 2y ago
If you ask me "What is 2+2" and I say "umbrella", that's not creativity.
If I'm an LLM model and alignment and fine tuning restricts my answers to "4", I've not lost creativity, but I have gained accuracy.
- hansvm 2y agoA weaker statement is that creativity is bounded by entropy. The LLM is still free to respond "Four," "four," "{{{{{}}}}}," "iv," "IV," etc. A sufficiently low-entropy response cannot be creative though.
- malfist 1y agoIs it though? An answer can still be creative if it's the only way you answer a specific question. In your example, if the LLM responded only "{{{{}}}}" that's a creative answer. Even if it's the only one it can give. Entropy and creativity are not causally bound
- hansvm 1y agoThat's a fair point. I think maybe the issue is one of the reference point we're implicitly choosing for creativity. "{{{{}}}}" is creative relative to our expectations for the problem -- falling outside the usual distribution of answers -- having high joint entropy. Relative to the person reading the response, I agree creativity could be high with model entropy remaining low.