3 ms·
>It takes coaxing (and some cherry-picking) to get anything creative out of LLMs I assume by LLMs you actually mean "ChatGPT and similar commercial LLM service
by logicchains 3y ago
>It takes coaxing (and some cherry-picking) to get anything creative out of LLMs
I assume by LLMs you actually mean "ChatGPT and similar commercial LLM services". Raw LLMs like LLaMA and Falcon will happily spout out the craziest, sometimes super creative ideas, it's just the lobotomising of ChatGPT and the like that destroys their creativity.
- SketchySeaBeast 3y agoIsn't a problem that the more creativity the more likely it'll also be nonsensical or off topic?
- circuit10 3y agoWell, it's a tradeoff, RLHF also makes ChatGPT better at some tasks like instruction following. "lobotomising" makes it sound like there are only downsides