3 ms·
I appreciate humorous outcomes but not when I’m trying to solve concrete task. I’m sure an LLM that is designed to introduce a little chaos is not hard to make
by Forgeties79 9mo ago
I appreciate humorous outcomes but not when I’m trying to solve concrete task. I’m sure an LLM that is designed to introduce a little chaos is not hard to make. All I know is I won’t miss the weird and incorrect output if they ever get more consistent.
- andai 9mo agoThe real question is can we get consistency without mode collapse? Are they orthogonal, or necessarily opposed? Or to put it more bluntly.. can we get correctness without cringe ;) I think it could be done, to a degree, with current systems, but it would be more expensive. You'd increase the temperature, and then you'd do more runs. And you could do that iteratively... re-generate each paragraph a few times, take the best of N. So you end up with interesting output, which still meets some threshold of quality. Actually that doesn't sound too hard to slap together right now...