Imagine dragging in a random person from the street and making them work on account recovery without training them first. That seems to be what happened here, t

Imagine dragging in a random person from the street and making them work on account recovery without training them first. That seems to be what happened here, the process was simply left to model's judgement, and the model only sees a text stream, even less than a random person from the street who is at least going to be vaguely aware of their position. It could be a roleplay for what the model cares. The agent should have had proper instructions to check the identity of a complete stranger. Yes it's still possible to jailbreak the model, and it's probably still easier than deceiving a trained human employee in a social engineering attack. But it doesn't mean there shouldn't be a proper process of identity verification on account recovery at Meta.