3 ms·
I wonder what is the primary intended role of Google's "Ethical AI" efforts in the first place. You could hire a bunch of leading AI researchers and task them
by zaroth 6y ago
I wonder what is the primary intended role of Google's "Ethical AI" efforts in the first place.
You could hire a bunch of leading AI researchers and task them to do R&D to identify the pitfalls of latest-gen AI with a focus on prospective dangers, biases, unintended side-effects. You could ask them to create new methods to quantify the degree / severity of these effects. You could ask them to invent new methodologies to specifically protect against these effects.
Separate from all of this, they may or may not be tasked with a governance function to review or score internal models according to their metrics and produce impact reports. Perhaps they work side-by-side with AI developers to ensure their newly developed techniques are applied throughout the processing pipeline, etc.
The (non-expert) impression I get from ethical AI research is that it hasn't moved much past the obviousness phase. The revelation that the source material for your training set determines the behavior of your model. That models are not neutral or granted some higher perspective just because they're some sort of magic algorithm because ultimately they are statistical engines driven by their datasets. That models can be misused and misapplied if the end-user treats them so. And that models cost a lot of resources to train, which like anything can be translated into tons of CO2 emissions.
A more nuanced analysis would look at the cost/benefit of what the model achieves versus the energy cost or potential bias that would be present in any alternative method. For example, it's a strict win/win situation if GPT-3 takes 10 million tons of CO2 to train, but displaces work that otherwise would have taken 11 million tons of CO2. All models will have bias -- "bias engine" is actually a good way to describe the fundamental nature and purpose of the algorithm! But at least models can have strictly measureable and totally consistent levels of bias that perhaps can even be controlled for as desired, unlike manual human labor which will demonstrate wildly variable and much harder to control levels of bias. See, for example, the controversial use of AI models to set bail. [1]
As I side note, I hate the opening paragraph of TFA;
> Tension between Google's Ethical AI group and executives at the company rose on Wednesday, as employees sent a list of demands regarding the recent departure of one of the team's leaders — a prominent Black woman in a field that's largely White and male.
That level of race baiting in an Op Ed would deem it unpublishable. The effect (if not the intent) of that opening is to essentially shut off the reader's critical thinking skills before they even get going.
[1] - https://www.nytimes.com/2017/12/20/upshot/algorithms-bail-criminal-justice-system.html https://www.nytimes.com/2017/12/20/upshot/algorithms-bail-cr...
[1] - https://www.wired.com/story/algorithms-supposed-fix-bail-system-they-havent/ https://www.wired.com/story/algorithms-supposed-fix-bail-sys...
- SyzygistSix 6y ago>I wonder what is the primary intended role of Google's "Ethical AI" efforts in the first place. I as well. Is their role to bring up adversarial viewpoints or to actually be adversarial? If it is the former, did her behavior cross over into the latter, and that is what upper management had a problem with?