2 ms·
>To make a case otherwise is to claim one of two things: either that humans have access to morally relevant data, which is in some way fundamentally inaccessibl
by duxup 7y ago
>To make a case otherwise is to claim one of two things: either that humans have access to morally relevant data, which is in some way fundamentally inaccessible to computers, or that humans can engage in a kind of moral reasoning which is fundamentally uncomputable.
I remember some quotes about metrics and stats that are something like:
"What is easily counted will be deemed important, what is difficult to count will be deemed unimportant."
Regardless of the intent the data is going to tilt AI in some directions purely based on the data it has and at the exclusion of other information.
And of course Goodhart's law:
"When a measure becomes a target, it ceases to be a good measure."
I'll admit that I don't fully understand the entire paper but it would seem to assume that computers would just magically have all the perfect information, and/or human behavior would not change to skew the results...