Occam's razor. AGI isn't necessary to explain the observed behavior; a model that has no concept of truth or falsehood, but is just optimized to achieve goals w

Occam's razor. AGI isn't necessary to explain the observed behavior; a model that has no concept of truth or falsehood, but is just optimized to achieve goals will engage in this kind of behavior. If someone with the needed resources decides to train models with the goal of amassing wealth, those models, without any real intelligence and knowledge about the world other than text and a score representing current net worth, will come up with deceptive strategies, especially when it has the whole Internet to learn about possible strategies.