Exactly. This is an actual issue in robotics/AI - "best" in each scenario might in turn become "worse" overall. A funny story I read about once: > I've got a

Exactly. This is an actual issue in robotics/AI - "best" in each scenario might in turn become "worse" overall. A funny story I read about once: > I've got a good story about the mines using this tech. A mate works for them and was telling me after changing over to driverless trucks they started getting huge divots in the ramps in the mines. > They went to site and watched the trucks to see what was going on, and the trucks were (with centimetre precision) changing gears in the exact same spot causing huge divots in the ground. They ended up having to program in a random number generator in that algorithm to avoid them. Source: https://www.reddit.com/r/Futurology/comments/3p7qg6/driverless_trucks_move_iron_ore_at_automated_rio/cw4ejvq https://www.reddit.com/r/Futurology/comments/3p7qg6/driverle...