One would think humans couldn't be phished, as well, but it's actually a very hard problem to prevent behaviors that violate specific contextual rules or norms,

One would think humans couldn't be phished, as well, but it's actually a very hard problem to prevent behaviors that violate specific contextual rules or norms, or even to formally specify those rules and norms and the contexts they must be obeyed in. This is a subset of the AI Alignment problem.