4 ms·
Another small nit, you're right regarding hallucinations but I like to highlight that they can actively lie if not trained not to. GPT-4 creating the "internal
by flangola7 3y ago
Another small nit, you're right regarding hallucinations but I like to highlight that they can actively lie if not trained not to. GPT-4 creating the "internal monologue" thought of "I need to say something to this TaskRabbit user to convince them to complete this captcha" and then sending the user a message that they have impaired vision is not a hallucination.
If that came from an organic brain we would call that clear intent.
- fnordpiglet 3y agoFair enough, perhaps the guard rails in public on LLM are creating a serious false sense of security. But absolutely you can inject a persona that is intentionally deceitful. I would however stop stick with “lying requires agency,” even if the model evaluation is crafted to be deceitful. The intent and the agency lies with the prompt creator, and therefore, IMO, the lie starts and ends there.