I think the problem might be even more complex than that. From what you’ve said they seem to be training AI to predict what people want and how valuable it is t

I think the problem might be even more complex than that. From what you’ve said they seem to be training AI to predict what people want and how valuable it is to them. This problem used to be the role of the giant distributed computational process know as the Free Market. Communism/Socialism famously found that problem too hard to solve and collapsed as a result. If there’s a new way to solve it, it’s both hard to argue that’s a bad thing, and a major threat to many of society’s institutions.