4 ms·

Wasn't a similar claim made about an AI detecting skin cancer from moles? Once the AI was deployed in the real world is failed miserably. I think it was a ton o

Wasn't a similar claim made about an AI detecting skin cancer from moles? Once the AI was deployed in the real world is failed miserably. I think it was a ton of false-positives because it was trained on images where cancerous moles all had images of rulers with them and the benign ones didn't have rulers in the image. So it just picked up on the ruler as a cancer indicator.

et2o 7y ago
Yeah. Long term it still looks like that idea might work out, but that was a funny story. This paper offers like 1/1000th the evidence of that one.
deleted 7y ago
[deleted]
Sanzig 7y ago
Would you happen to have a source for that story? My workplace has really swallowed the AI Kool-Aid lately, so I would like to have some cautionary counterexamples to demonstrate potential pitfalls of the technology. It's got a lot of interesting applications for our field which I am excited about, but there seems to be a tendency among non-experts to consider it a magic bullet that can solve any sort of problem. In particular, I am concerned about applications where conventional approaches have already converged on an optimal solution that's used operationally, but somebody wants to throw AI at it because they thought it might be cool without first understanding the implications.
- carbocation 7y ago
  Citation: https://jamanetwork.com/journals/jamadermatology/article-abstract/2740808 https://jamanetwork.com/journals/jamadermatology/article-abs... From the abstract: This study’s findings suggest that skin markings significantly interfered with the CNN’s correct diagnosis of nevi by increasing the melanoma probability scores and consequently the false-positive rate. A predominance of skin markings in melanoma training images may have induced the CNN’s association of markings with a melanoma diagnosis. Accordingly, these findings suggest that skin markings should be avoided in dermoscopic images intended for analysis by a CNN.
- 3b18 7y ago
  Check this link out http://132.206.230.229/e706/gaming.examples.in.AI.html http://132.206.230.229/e706/gaming.examples.in.AI.html There was a hn discussion about it a while back: https://news.ycombinator.com/item?id=18415031 https://news.ycombinator.com/item?id=18415031
  - deleted 7y ago
    [deleted]
  - carbocation 7y ago
    What a great resource! The first example is perfect: > Aircraft landing > Evolved algorithm for landing aircraft exploited overflow errors in the physics simulator by creating large forces that were estimated to be zero, resulting in a perfect score
  - stevula 7y ago
    Very amusing. Some of my favorites: > In an artificial life simulation where survival required energy but giving birth had no energy cost, one species evolved a sedentary lifestyle that consisted mostly of mating in order to produce new children which could be eaten (or used as mates to produce more edible children). > (Tetris) Agent pauses the game indefinitely to avoid losing >Agent kills itself at the end of level 1 to avoid losing in level >Robot hand pretending to grasp an object by moving between the camera and the object
- jvm_ 7y ago
  Stolen from another HN comment about using AI on medical records. "Finasteride is a compound that is used in two drugs. Proscar is used for prostate enlargement. It is old, out-of-patent, and has cheap generics. Propecia is used for hair loss. It is a newer, and (at the time) very expensive. The only difference is that Propecia is a lower-dose formulation. What people did was to ask their doctors to perscribe generic Proscar, and then break the pills up to take for hair loss. Doctors would then justify the prescription by "diagnosing" enlarged prostate. This would enter the patient's health records. If you apply deep learning without being aware of this "trick", you would learn that a lot of young men have enlarged prostates, and that Proscar is an effective, well-tolerated treatment for it. Health records are often political-economic documents rather than medical."
gwern 7y ago
> Once the AI was deployed in the real world is failed miserably. They didn't show that.

et2o 7y ago

Yeah. Long term it still looks like that idea might work out, but that was a funny story. This paper offers like 1/1000th the evidence of that one.

deleted 7y ago

[deleted]

Sanzig 7y ago

Would you happen to have a source for that story? My workplace has really swallowed the AI Kool-Aid lately, so I would like to have some cautionary counterexamples to demonstrate potential pitfalls of the technology. It's got a lot of interesting applications for our field which I am excited about, but there seems to be a tendency among non-experts to consider it a magic bullet that can solve any sort of problem. In particular, I am concerned about applications where conventional approaches have already converged on an optimal solution that's used operationally, but somebody wants to throw AI at it because they thought it might be cool without first understanding the implications.

carbocation 7y ago
Citation: https://jamanetwork.com/journals/jamadermatology/article-abstract/2740808 https://jamanetwork.com/journals/jamadermatology/article-abs... From the abstract: This study’s findings suggest that skin markings significantly interfered with the CNN’s correct diagnosis of nevi by increasing the melanoma probability scores and consequently the false-positive rate. A predominance of skin markings in melanoma training images may have induced the CNN’s association of markings with a melanoma diagnosis. Accordingly, these findings suggest that skin markings should be avoided in dermoscopic images intended for analysis by a CNN.
3b18 7y ago
Check this link out http://132.206.230.229/e706/gaming.examples.in.AI.html http://132.206.230.229/e706/gaming.examples.in.AI.html There was a hn discussion about it a while back: https://news.ycombinator.com/item?id=18415031 https://news.ycombinator.com/item?id=18415031
- deleted 7y ago
  [deleted]
- carbocation 7y ago
  What a great resource! The first example is perfect: > Aircraft landing > Evolved algorithm for landing aircraft exploited overflow errors in the physics simulator by creating large forces that were estimated to be zero, resulting in a perfect score
- stevula 7y ago
  Very amusing. Some of my favorites: > In an artificial life simulation where survival required energy but giving birth had no energy cost, one species evolved a sedentary lifestyle that consisted mostly of mating in order to produce new children which could be eaten (or used as mates to produce more edible children). > (Tetris) Agent pauses the game indefinitely to avoid losing >Agent kills itself at the end of level 1 to avoid losing in level >Robot hand pretending to grasp an object by moving between the camera and the object
jvm_ 7y ago
Stolen from another HN comment about using AI on medical records. "Finasteride is a compound that is used in two drugs. Proscar is used for prostate enlargement. It is old, out-of-patent, and has cheap generics. Propecia is used for hair loss. It is a newer, and (at the time) very expensive. The only difference is that Propecia is a lower-dose formulation. What people did was to ask their doctors to perscribe generic Proscar, and then break the pills up to take for hair loss. Doctors would then justify the prescription by "diagnosing" enlarged prostate. This would enter the patient's health records. If you apply deep learning without being aware of this "trick", you would learn that a lot of young men have enlarged prostates, and that Proscar is an effective, well-tolerated treatment for it. Health records are often political-economic documents rather than medical."

gwern 7y ago

> Once the AI was deployed in the real world is failed miserably. They didn't show that.