3 ms·
> This is fundamentally the data quality issue That contributes to this outcome, but I think the fundamental issue is deeper in how the algorithm is a kind of
by Terr_ 2y ago
> This is fundamentally the data quality issue
That contributes to this outcome, but I think the fundamental issue is deeper in how the algorithm is a kind of autocomplete being applied to an incremental play-script, with no inherent concept of itself being one of the actors or of truth versus contradiction.
That's why you can instruct an LLM to disregard all prior instructions, or tell it to tell itself to imagine acting like it was disregarding prior instructions, etc... And if that's possible, why bother with a regular scam? Just command it to do what you want.
> We don't want AIs to do what the average human would do [...] Getting a model to fairly challenge your assumptions
To recycle a comment from a week ago regarding an LLM character backstory generator:
> on reflection I think a human touch is going to be required when you want backstory which breaks or subverts common tropes and stereotypes. This makes sense if you view LLMs as primarily following connections that are already popular within their training data, and popular things are things readers are likely to anticipate.
While I'm sure you could get an LLM to output challenges to common assumptions... The the challenges themselves may suffer from the same kind of bias.
"LLM, when the hero meets the villain, add a twist that challenges expectations."
"Okay: The villain reveals that he is actually the protagonist's father!"