4 ms·

Stephen makes a lot of good points. And the list of questions he says people should ask is also useful. I have a few to add: * What algorithm(s) are you using?

• Smerity 10y ago
  Great additions. I can't believe I missed "what algorithm(s) are you using" - it didn't even occur to me people could skip those yet still be taken seriously though that was (obviously) the case with the company I referred to in the article given they pitched AI when they had none. I agree with you and Francois about the future potential enabled by AI. I do think we're at the early days of the internet where we can see it enables many things but we're not really accurate about predicting more than a year or two in the future. Hype is just noise distracting us from the important contributions and issues we should be concerned over. I'm more worried about the immediate future of ML algorithms being misused, resulting in modern day redlining[1] and so on, than I am about any SkyNet prophecy. [1]: https://en.wikipedia.org/wiki/Redlining https://en.wikipedia.org/wiki/Redlining
  • vonnik 10y ago
    I agree with you about redlining. I hadn't really thought about that... A recent scandal involving a predictive analytics firm called Northpointe shows how stupidly people use algorithms, and how much they are abused when there is no transparency: https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing https://www.propublica.org/article/machine-bias-risk-assessm...
    • yummyfajitas 10y ago
      The scandal is that propublica wrote a story which directly contradicts their own statistical analysis. Their analysis was unable to show statistically significant bias (and had other flaws that might be genuine mistakes - no multiple comparison correction, possible misinterpretation of the model). https://www.chrisstucchio.com/blog/2016/propublica_is_lying.html https://www.chrisstucchio.com/blog/2016/propublica_is_lying.... In fact, their r-script suggests that the secret algorithm is probably reducing racism relative to whatever secret algorithm human judges would use.
  • iandanforth 10y ago
    Isn't that explicitly what OpenAI was formed to prevent?
    • Smerity 10y ago
      The OpenAI team would be best to comment but I've not seen them note any specific intent[1] to research topics related to fairness, accountability and transparency in ML. I use those words specifically as FAT ML 2015 was part of ICML 2015[2]. While a great start, that area of research doesn't get anywhere near the attention it should given the gravity of the potential findings. These issues are already in existence. Given ML systems are being used to filter resumes, decide whether someone should get a loan (and how much their interest rate should be), and find matches on dating services, the fact that ML systems may inadvertently feature racial or gender bias is hugely disturbing. This is likely to only get worse over time as more and more systems feature ML components. As a simple example, word vectors are used by just about every deep learning system and recent research has found gender and racial stereotypes strongly embedded in them[3]. There's very confusing debate as to what this implies for the data, the models, and predictions[4]... :S father:doctor :: mother:nurse, man:programmer :: woman:housemaker black_male>assaulted, whilte_male>entitled_to I wish I was making those examples up but they're straight out of their analysis. They also only focus on gender stereotypes but you can imagine how many similar issues might be hidden away just beneath the surface. Even if OpenAI indicated they were explicitly interested in that direction, which afaik they haven't, it's still an area that should be of interest to the field broadly. OpenAI is still a small team and I'm certain they'd appreciate the help, especially as they already have a lot on their plate :) A disaster scenario for me is to have ML systems help reinforce the negative aspects of our society, conveniently hidden in a black box which can never be properly inspected. [1]: I'm primarily running off what I've seen in the recent past and their technical goals that they recently published at https://openai.com/blog/openai-technical-goals/ https://openai.com/blog/openai-technical-goals/ [2]: http://www.fatml.org/ http://www.fatml.org/ [3]: "Quantifying and Reducing Stereotypes in Word Embeddings" - https://arxiv.org/abs/1606.06121 https://arxiv.org/abs/1606.06121 [4]: https://twitter.com/jackclarksf/status/746039805595762688 https://twitter.com/jackclarksf/status/746039805595762688
• graycat 10y ago
  > What algorithm(s) are you using? Nobody should be able to brag publicly about their AI without simply naming the algorithms. What if the algorithms are original from, say, new theorems and proofs in applied math, so far have no names, and, really, are not related to well known AI algorithms at all?
  • vonnik 10y ago
    Whatever they are, they're either similar to algorithms that some human has used previously, or the employ mathematical ideas that others would have named and understood. So you could explain it by saying it's like X but with Y modifications.
    • graycat 10y ago
      Right. But in practice here I have to expect, from the rest the author wrote, that what he meant was one of supervised learning, unsupervised learning, machine learning, convolutional neural networks, natural language processing, computer vision, etc.