16 ms·
ML model can classify sex from retinal photograph, clinicians can't
- phnofive 6y agoThe link points to some sort of viewer which lagged badly for me - here’s the PDF: https://www.nature.com/articles/s41598-021-89743-x.pdf https://www.nature.com/articles/s41598-021-89743-x.pdf
- sxg 6y ago(My mistake, missed their external validation)
- Isinlor 6y agoThey did external validation. > External validation was performed on the Moorfields dataset. This dataset differed from the UK Biobank development set with respect to both fundus camera used, and in sourcing from a pathology-rich population at a tertiary ophthalmic referral center. The resulting sensitivity, specificity, PPV and ACC were 83.9%, 72.2%, 78.2%, and 78.6% respectively
- deleted 6y ago[deleted]
- kevingadd 6y agoI would be curious whether this is actually classifying something that typically corresponds with sex, like hormone levels. In that case people with hormonal disorders would potentially be mis-classified, and someone photographed pre/during puberty might also be mis-classified. Since the paper mentions both neural and vascular tissue being represented in retinal photos, it seems like the levels of various hormones in the individual's blood could potentially also generate a mis-classification if they (for example) cause blood vessels in the eye to expand or contract. The mention that foveal pathology causes the model to mispredict suggests it would probably have issues in these cases too, I think. I wonder what actual values they were trying to predict with this analysis? Based on the paper, I get the impression they were trying to do something more interesting and they got the best data for sex.
- cassonmars 6y agoI wonder this too, and they could get a pretty solid answer if they incorporated transgender folks’ data into the set since they’re actively keeping their hormones in the desired ranges of their gender identity.
- esyir 6y agoGenerally you'd start with the common, easier problem before you delve into the abnormal cases. There are probably better ways to do that, like looking at bloodwork.
- lukeschlather 6y agoThat's fine for training, but for testing the model delving into abnormal cases seems required. If there's noticeable difference on abnormal cases that gives a lot of insight into what your model is actually testing.
- cassonmars 6y agoAll observations about the use of the term “abnormal” aside, I agree the idea of specifically isolating the hormone variable by using groups of people who naturally fit that range and groups of people that use medication to mirror that range would at least indicate whether this classifier is picking up on sexual dimorphism or vascular effects from hormonal differences (which also would potentially impact not only transgender people, but intersex people — who make up around 3% of the population)
- spuz 6y agoThey were specifically trying to classify sex because it is something that experts cannot already do: > While our deep learning model was specifcally designed for the task of sex prediction, we emphasize that this task has no inherent clinical utility. Instead, we aimed to demonstrate that AutoML could classify these images independent of salient retinal features being known to domain experts, that is, retina specialists cannot readily perform this task.
- p1esk 6y agoHow long did they train humans to perform this task?
- NoPie 6y agoDo we even need clinicians be able to distinguish male and female retinas? The task is meaningless. Yes, there might be some interesting facts in discovery how male and female retinas are different. It could even lead to differentiated treatments. But ML hasn't provided any clues regarding this and therefore it is not that deep.
- p1esk 6y agoIt's not about differentiating male and female retinas (that's just a PoC to publish the paper), it's about using ML to find something useful in data (e.g. signs of a disease) which might be hard to see for humans otherwise.
- dkarras 6y agoI don't think we even know what to look for yet. >Clinicians are currently unaware of distinct retinal feature variations between males and females, highlighting the importance of model explainability for this task.
- Causality1 6y agoFascinating. I had no idea retinas were sexually dimorphic. I wonder if the difference serves a purpose or is just a consequence of some other adaptation.
- slibhb 6y agoNeither did doctors apparently. If everything is kosher, they've proved some level of sexual dimorphism and now they can investigate and perhaps find out what it is. This is an interesting use of machine learning. We (or at least I) normally think of these models as replacing or complementing humans. But using them as a driver for research is cool.
- esyir 6y agoThere's also the risk of severe overfitting to some latent variable. I haven't quite dug into the work itself yet, but it does bring back memories of some case of perfect diagnosis due to hospital documentation process though.
- amelius 6y agoWhat network topology did they use? I couldn't find it in the paper.
- kevinventullo 6y agoIn the section Model Training: “Our deep learning model was trained using code-free deep learning (CFDL) with the Google Cloud AutoML platform ... the CFDL platform provides the option of image upload via shell-scripting utilizing a .csv spreadsheet containing labels ... Automated machine learning was then employed, which entails neural architecture search and hyperparameter tuning.” Earlier, in the Limitations section: “The design of the CFDL model was inherently opaque due to the framework’s automated nature with respect to model architecture and hyperparameters. While this opacity is not unique to CFDL, there is potential to further reduce ML explainability due to lack of insight of model architectures and parameters employed.” Maybe there’s a whitepaper somewhere on how Google’s AutoML works?
- teruakohatu 6y agoMy understanding is that is uses heuristics to try a range of different base models and techniques based on the input data, along with grid searchs to find hyper parameters. It is fairly pricey but works. It is probably not super exotic, but if they spent enough money optimizing it, it probably has good hyper params.
- cerved 6y agoThis doesn't seem terribly well framed. Classifying the sex from a retinal photograph is useless. Obviously clinicians aren't going to be good at it. At which point I've lost interest
- spuz 6y agoThe paper is about 4 pages long - it takes about as long as it to you to write that comment as it does to skim through and learn that what you mentioned is exactly why they did the study: > While our deep learning model was specifcally designed for the task of sex prediction, we emphasize that this task has no inherent clinical utility. Instead, we aimed to demonstrate that AutoML could classify these images independent of salient retinal features being known to domain experts, that is, retina specialists cannot readily perform this task. It always amazes me how people spend 5 seconds reading a headline but think they know more than someone who has spent days and months on the same topic.
- cerved 6y agoIt's just an honest take. If I was more interested in the subject maybe I would skim more but I'm not interested enough. Not trying to shit on anyone, it's just a brutally honest opinion
- spuz 6y agoSorry I misinterpreted then. I thought you were dismissing it out of negativity but actually it's worse - you actually made a judgement that you knew more than the authors of the study.
- cerved 6y agoThe only judgement I made was to not read the whole paper. I read up until the paper stated that classifying sex based on retinal pictures was unlikely to be clinically useful. At which point I lost interest. Why wasn't the ML model and clinician classifying something that actually is clinically useful? If it has no clinical significance, what's the relevance of the classification of the clinicians? How is it any more spectacular than beating a random classifier? Had these points been addressed at this point I might have continued reading
- Traster 6y ago>Clinicians are currently unaware of distinct retinal feature variations between males and females, highlighting the importance of model explainability for this task. If I'm reading this correctly what they're saying is that since we don't currently know the difference between male and female retinas, being able to explain what the ML black box is doing is important. But from what I can see in the paper they basically don't know what the black box is doing, they really don't understand what features their tool has isolated. I might be misunderstanding though?
- oogabooga123 6y agoYour question is confusing, it might be that you are using “feature” in an ML sense and the quote refers to human describable distinctions we know about? But I still don’t know how to parse your question. The model can predict male vs female retinas but they don’t understand why. What exactly are you asking?
- TaylorAlexander 6y agoML models have layers, and neurons in a given layer detect “features” in the image or in the previous layer. So yes I believe the person meant which structures in the image are activating the network. Which is a well studied area so it is surprising the authors didn’t explore that.
- NieDzejkob 6y agoYes, they are highlighting the importance of research towards model explainability.
- slver 6y agoI believe that’s impossible.
- TaylorAlexander 6y agoML explainability is a wide field with a lot of success. For example you can discover what features are activating which detections. You comment, taken literally, suggests that research in this field is impossible. That is not the case.
- wizzwizz4 6y agoOdds on it detecting mascara or eyelashes or some other makeup? Retinal photos have to go through the front of the eye, after all.
- terramex 6y agoIf there ever was mascara on your retina you better be going to the hospital quickly.
- deleted 6y ago[deleted]
- Blikkentrekker 6y agoIt's entirely possible that it reduces the amount of light that enters the retina on averaqe, thus affecting the picture.
- YeGoblynQueenne 6y agoThat's a bit of an exaggeration. Mascara in the eye happens very often, to me anyway. What's really painful is the hairs off the mascara brush detaching and insinuating themselves under the eylid. That. hurts.
- capableweb 6y agoAs this is HN, the previous comment is to be take literally and pedantically, as is tradition. They are talking about mascara on the retina (inside your eye), not just mascara on the outside. Mascara on your retina would most likely end up in a hospital visit. The first question? How the fuck you manage to get mascara on your retina?!
- hermitdev 6y ago> Mascara on your retina would most likely end up in a hospital visit. ... And likely blindness. The retina is the inside of the back of your eye, where the optic nerve attaches. If you have mascara on your retina, it means you have punctured your eye. Having something between your cornea and eye lid, while extremely irritating and painful - especially if a scratch results, is far, far less painful than having something puncture your cornea. Trust me, I've had surgery behind the cornea and had the anesthesia wear off.
- maCDzP 6y agoI am going to drop a thought here to see what happens. If there is a difference between male/female retinas. Could this affect our perception of reality?
- BurningFrog 6y agoMy guess: Only in trivial ways. The fact that women see the world from a ~20cm lower point probably has real impact. For one thing, guys, your nose hair is very visible from that height.
- NaturalPhallacy 6y agoA few funny anecdotes in that vein. A woman complained that her very tall boyfriend had hung a mirror in the bathroom. She took a picture of it. It was her reflection holding the camera level with the top of her head, and little else. One that happened to me personally. I asked my then gf (5'1") what it was like being a small person, do you feel like a normal sized person in a land of giants? "Yes" was the instant response. One very tall guy once remarked: "The tops of your fridges are fucking disgusting."
- xorfish 6y ago> A woman complained that her very tall boyfriend had hung a mirror in the bathroom. She took a picture of it. It was her reflection holding the camera level with the top of her head, and little else. As a tall guy, there is a surprising number of bathroom mirrors where my reflection doesn't include my head.
- gweinberg 6y agoYou people need some taller mirrors. The bottom of my bathroom mirror is several inches blow my waist. The top is about a foot and a half above the top of my head.
- slver 6y agoNo
- zephyr____ 6y agoThis is a step backwards for LGBTQI rights. It is scientifically proven that there are no differences between men and women. I hope the inevitable retraction gets as much attention on HN.
- stirfish 6y ago>It is scientifically proven that there are no differences between men and women. https://en.m.wikipedia.org/wiki/Sexual_dimorphism https://en.m.wikipedia.org/wiki/Sexual_dimorphism
- rs999gti 6y ago> It is scientifically proven that there are no differences between men and women. XY and XX chromosomes don't matter? Then what are all those fertility doctors doing?
- claudiawerner 6y agoDon't feed the troll.
- stewbrew 6y ago"model was trained on 84,743 retinal fundus photos from the UK Biobank dataset. External validation was performed on 252 fundus photos" Is it common practice in this field to test an overfitted model's performance with such a small data set so that the test could yield random results?
- hervature 6y agoThe probability of a 50% guess getting 75% accuracy (I believe the paper is something like 77.2%) on 252 trials is 1 in 10^15.
- stewbrew 6y agoGood point but you should probably use the prob that it's 75% or higher.
- drdeca 6y agoAre you asserting that it is overfit? Also, before they tested on the other smaller dataset from a different source, aiui, they also trained only on the earlier subset of the first source, and used the later portion from the first source (with no overlap in patients) for the testing. (also, I'm not sure that 252 is really all that small?)
- avalys 6y agoThat was not the only validation set they used.
- make3 6y agoWhy do you say that the model is overfitted? You have no way of knowing that. Plus, 84 743 is a very reasonable size for a vision dataset with a binary prediction
- fxtentacle 6y agoSome women have 4 types of color rods, all men have only 3.
- galangalalgol 6y agoDon't all women have 6 types but usually they all have very similar or even identical frequency response? Only when they have a colorblind gene are they noticeably different.
- fxtentacle 6y agoI meant this one: https://en.wikipedia.org/wiki/Tetrachromacy https://en.wikipedia.org/wiki/Tetrachromacy "Tetrachromacy is the condition of possessing four independent channels for conveying color information, or possessing four types of cone cell in the eye." https://jov.arvojournals.org/article.aspx?articleid=2191517 https://jov.arvojournals.org/article.aspx?articleid=2191517 "12% of women are carriers of [..] anomalous trichromacy."
- galangalalgol 6y agoYes, it says it is from carrying a colorblind gene, usually red-green. But they have six copies of rhodopsin encoding dna, usuall 3 of them are duplicates. In red green colorblind only two are duplicates, but there are other types of colorblind. Theoretically they could be hexachromatic
- YeGoblynQueenne 6y agoFrom the wikipedia page linked in your comment: One study suggested that 15% of the world's women might have the type of fourth cone whose sensitivity peak is between the standard red and green cones, giving, theoretically, a significant increase in color differentiation.[23] Another study suggests that as many as 50% of women and 8% of men may have four photopigments and corresponding increased chromatic discrimination compared to trichromats.[24] It's not just women.
- 6y ago
- drcode 6y agoKeep in mind ML models are really great at cheating to get answers: Maybe it's detecting that women have to tilt their head up more to reach the retinal photography machine, because they're shorter on average. Maybe, some of the images come from an optometrist that specializes in women's glass frames, and his retinal photography machine has a slightly dimmer bulb. Maybe, men are more likely to get a retinograph only when they have more severe disease already, so the retinas look different for that reason.
- Baeocystin 6y agoTo wit- the apocryphal Tank story: https://www.gwern.net/Tanks https://www.gwern.net/Tanks
- sgt101 6y agoapocryphal ehh?
- B1FF_PSUVM 6y ago""" Once upon a time—I’ve seen this story in several versions and several places, sometimes cited as fact, but I’ve never tracked down an original source—once upon a time, I say, the US Army wanted to use neural networks to automatically detect camouflaged enemy tanks. The researchers trained a neural net on 50 photos of camouflaged tanks amid trees, and 50 photos of trees without tanks. Using standard techniques for supervised learning, the researchers trained the neural network to a weighting that correctly loaded the training set—output “yes” for the 50 photos of camouflaged tanks, and output “no” for the 50 photos of forest. Now this did not prove, or even imply, that new examples would be classified correctly. The neural network might have “learned” 100 special cases that wouldn’t generalize to new problems. Not, “camouflaged tanks versus forest”, but just, “photo-1 positive, photo-2 negative, photo-3 negative, photo-4 positive…” But wisely, the researchers had originally taken 200 photos, 100 photos of tanks and 100 photos of trees, and had used only half in the training set. The researchers ran the neural network on the remaining 100 photos, and without further training the neural network classified all remaining photos correctly. Success confirmed! The researchers handed the finished work to the Pentagon, which soon handed it back, complaining that in their own tests the neural network did no better than chance at discriminating photos. It turned out that in the researchers’ data set, photos of camouflaged tanks had been taken on cloudy days, while photos of plain forest had been taken on sunny days. The neural network had learned to distinguish cloudy days from sunny days, instead of distinguishing camouflaged tanks from empty forest. """
- almog 6y agoJust throwing a guess here about one factor that partitions photos based on sex might: height (I'm assuming males are generally taller). Looking at how a retinal photography machine looks like, I'd guess the height at which the photo is taken might slightly affect the POV angle, which in turn might be just enough to get caught by the ML model.
- hellbannedguy 6y agoI had a Ph.D instructor in psychology. She said, women are actually taller than men when all cultures are studied. I don't care enough to dig deeper, but always stuck with me.
- Erik816 6y agoShe appears to have made that up: https://www.worlddata.info/average-bodyheight.php https://www.worlddata.info/average-bodyheight.php
- jan_Inkepa 6y agoThat's an unexpected (to me at least) claim to make - https://onlinelibrary.wiley.com/doi/abs/10.1002/ajpa.1330530314 https://onlinelibrary.wiley.com/doi/abs/10.1002/ajpa.1330530... - I always thought of sexual dimoprhism (men taller than women on average) as a given and this paper backs up my claim specifically in the context of human societies (where it gives a 10cm height advantage in average in men over women, comparing 216 different societies ). There might be some way of counting in which the converse is true, but not in any way I know. I understand you don't want to dig deeper, but thought I'd flag it in case anyone else unwittingly digests this (possibly wrong) knowldge. https://www.quantamagazine.org/males-are-the-taller-sex-estrogen-not-fights-for-mates-may-be-why-20200608/ https://www.quantamagazine.org/males-are-the-taller-sex-estr... is an example of a pop-sci article assuming the same basis (written by a biology phd).
- username90 6y agoPeople with Ph.D's often makes up facts and believes in nonsense just like everybody else. Edit: This includes those with STEM degrees as well. You really shouldn't trust someone more just because they have a research degree. I knew a professor who claimed to have solved some famous problems but that the peer reviewers just didn't want to accept that he solved it and therefore rejected his papers.
- StreamBright 6y agoML model can't explain how it classifies retinal photographs, clinicians can.
- fastaguy88 6y agoSexy title, but it is unclear that clinicians can’t classify sex from the retina, its just that they haven’t bothered to. And the classification is not that great (<80% PPV on independent data). Clinicians will certainly get much higher sensitivity, specificity, and PPV just by looking at the subject ;)
- Scoundreller 6y agoI remember a researcher doing some early research on compressing diagnostic imaging and was happy about all the hard disk space saved. They did some research to find out what level of compression they could go with that wouldn't result in different clinicians reaching different conclusions from the same images. It really upset me. We probably threw away decades of training data that a computer could have used for early detection. Fine for broken arms of whatever, but for cancer diagnostics, ugh. The computer might have been able to see the tumour before a clinician.
- SubiculumCode 6y agoIt is easy to forget, but disk space used to be a super precious resource for labs.
- grogenaut 6y agoThat data compression meant getting imagery to experts in less than an hour digitally instead of via sneakernet physically in a multi-day timeframe, thus massively speeding up and improving access to high quality diagnosis.
- Scoundreller 6y agoCould do both, but still depends on storage costs. But I guess re-scanning wouldn't get justified once there's already a "good enough" compressed version. Real question is if they dialed down the compression as storage got cheaper. Doubtful.
- Kliment 6y agoHere's a similar study from three years ago that tried to do the same with clinically relevant measures and got somewhat better results https://scihubtw.tw/https://www.nature.com/articles/s41551-018-0195-0 https://scihubtw.tw/https://www.nature.com/articles/s41551-0...
- DoubleDerper 6y ago"EK is a consultant for Google Health. PAK has received speaker fees from Heidelberg Engineering, Topcon, Haag-Streit, Allergan, Novartis and Bayer. PAK has served on advisory boards for Novartis and Bayer, and is a consultant for DeepMind, Roche, Novartis and Apellis. KB has received research grants from Novartis, Bayer. Heidelberg and Roche. KB has received speaker fees from Novartis, Bayer, TopCon, Heidelberg, Allergan, Alimera. KB is a consultant for Novartis, Bayer and Roche. AK is a consultant to Aerie, Allergan, Novartis, Google Health, Reichert and Santen. All other co-authors have no competing interests to declare." Worth noting.
- mahathu 6y agoThis is a really impressive result and an interesting result to apply ML to. Thank you for sharing, OP. I'm just wondering if there are any real world applications of why you'd want to tell the sex of a person by a retinal photograph? It seems like a bit of a useless skill to have?
- qayxc 6y agoI think this more an example how black-box models are basically useless for clinical research. The authors aren't aware of any distinguishing retinal features between male and female eyes and the model itself has no explanatory power. Could be a Clever Hans situation where the model exploits meta information of some kind in the absence of actual features. It could just as well mean that there are indeed distinguishing features that are compromised in the presence of foveal pathology. The authors note that another study using manually selected features identified three features that are indicative of genetical sex. These features yielded about 0.78 AUROC accuracy measure. Compared to the presented model's AUROC accuracy of 0.93 that's only 19% worse and these 19% additional accuracy may point to a combination of the already identified features or one or more additional features. I personally find this paper rather pointless. It stops at the point where actual progress could be made and things would get interesting - why didn't the authors evaluate the previously known features on the model's matches to measure their significance? This could have told them whether their black-box was relying on the same set of features as the ones identified by previous work, for example.
- Blikkentrekker 6y ago> I think this more an example how black-box models are basically useless for clinical research. A result different from the null hypothesis is useles. Let us say the machine could not succeed greater than chance, it would be a case of cosmic bad luck in that case, that all social and biological factors cancel each other out. Thus, in the case of the null hypothesis being confirmed by this, one may conclude that in all likelihood retinal patterns have no sexual divergence. But, machines very rarely find such a null hypothesis in such cases, and that might be in no small part because of all the extra factors that such models latch on to. I for one would be more interested in an obvious nonce test to see if the machine can find something: see if the a.i. can find a retinal difference between, say, the poor and the rich. If it can with high accuracy what retinae are poor, and what are rich, we might have a somewhat interesting situation.
- 988747 6y agoClinicians don't care, so they never learn to distinguish. It's that simple.
- rubatuga 6y agoI think this is an important point to say. We simply have no reason to use retinas to distinguish sex.
- contrarian_5 6y agothats going to be one of the biggest shocks to society going forward when it comes to the changes that AI bring. there are mountains of data everywhere that is completely overlooked simply because the cost of processing the data is too high. too high to discover patterns/correlation and too high to process in any case. human beings filter out most of what goes on around them. they dont see the world as it is and their minds dont keep track of physical primitives. their minds abstract the world into larger conceptual parts and track those parts. its not just a question of processing power, its a question of intuitive access. and nobody realizes this yet because the only sentient beings who are around to demonstrate any of this have those filters in place. when the AI comes with all that horse power and with no filters, it will see things all around that we are blind to. it will seem as though it can make impossible predictions. it will seem god-like, even before it graduates to doing something other than simply observing the world.
- chx 6y agoThey claim they are able to detect gender which according to the relevant Canadian government website https://cihr-irsc.gc.ca/e/48642.html https://cihr-irsc.gc.ca/e/48642.html > Gender refers to the socially constructed roles, behaviours, expressions and identities of girls, women, boys, men, and gender diverse people First it's not some hamfisted mixup of sex and gender: > Terefore, this feld may contain a mixture of NHS recorded gender and self-reported gender. Genetic sex in the UK Biobank was determined And yet: > Predicting gender from fundus photos, previously inconceivable to those who spent their careers looking at retinas, also withstood external validation on an independent dataset of patients with different baseline demographics Although not likely to be clinically useful, this finding hints at the future potential of deep learning for the discovery of novel associations through unbiased modelling of high-dimensional data. If we had a way to detect trans children, for sure that would be clinically useful! Edit: as always, thanks for the downvotes, but please also educate me where I am wrong.
- Blikkentrekker 6y agoLanguage belongs to everyone. Some specialists in their field make a distinction between “sex” and “gender”; others for instance do between “speed” and “velocity”, or “weight” and “mass”, vernacular, and in many fields, they are respective synonyms. Most technical terms start as lay terms in a language that are then given a more technical meaning, often pulling two synonyms apart in the process. On the note of “children”; I tried scanning the result for whether the machine can distinguish before puberty, which would be even more spectacular, but I couldn't find it in the article. — there is significant debate as to what extent non-genital sex characteristics exist before puberty, as the difference is often so small that they could easily be attributed purely to environmental or social factors.
- chx 6y agoThe vernacular, in this case, is obsolete. It needs to catch up. Sex and gender while often happens to be the same are not at all the same thing and we need to speak up against confusing the two for the sake of our trans friends.
- sojournerc 6y agoI'm curious if a difference in cone density or distribution could be the differentiator. https://theneurosphere.com/2015/12/17/the-mystery-of-tetrachromacy-if-12-of-women-have-four-cone-types-in-their-eyes-why-do-so-few-of-them-actually-see-more-colours/ https://theneurosphere.com/2015/12/17/the-mystery-of-tetrach...
- SubiculumCode 6y agoAs I look at the Figure 2. Region based saliency maps, I notice the high salience regions are the brightest area on the retinal image. I am not sure whether that is just a bright regions of the retina or it is the reflection of the light illuminating the retinal scanner. In any case, it is interesting to me that this seems to be the regions that helps discriminability the most (if I am understanding correctly), which is surprising to me.
- caslon 6y agoThis isn't necessarily surprising. We've known that hormones have a particularly strong effect on the eyes for a long time. https://www.aao.org/eye-health/tips-prevention/how-hormones-can-affect-eyes-vision https://www.aao.org/eye-health/tips-prevention/how-hormones-... Thanks to hormones, women may experience vision changes throughout their adult lives. The hormones estrogen and progesterone have a lot to do with this. Their changing levels can affect the eye’s oil glands, which can lead to dryness. Estrogen can also make the cornea less stiff with more elasticity, which can affect how light travels into the eye. The dryness and the change in refraction can cause blurry vision and can also make wearing contact lenses difficult.
- m3at 6y agoThis was surprising to me, I did not know. Thank you for sharing!
- Seattle3503 6y agoIn figure 1 it looks like we have 50% precision at 100% recall. I don't do a lot of binary classification, but should it be concerning for the model if it is only right half the time (random chance) when we demand it predicts for all data?
- cschmid 6y agoFor a binary classifier, recall is defined as the true positive rate: Of all the samples that are actually positive, how often did our model output "positive". To get this to 100%, the model would simply say "positive" all the time. This means that the precision (the fraction of samples where the classifier said "positive" that were actually positive) goes to 50% (for a balanced dataset).
- Seattle3503 6y agoBut it should be possible to get 100% recall with higher than 50% precision if you have a good classifier right?
- winstonewert 6y agoNo. Only if you had a perfect classifier. The only way to have 100% recall is to have absolutely no false negatives. In practice, the only way to have no false negatives is to have no negatives at all.
- marcodiego 6y agoReading the title I thought it was a ML model capable to classify retinal photograph from porn.
- doggodaddo78 6y agoThe next step in ML is to communicate in English what are the essential discriminant attributes it found.
- killjoywashere 6y agoI’ve been hearing this since at least 2016. Saliency labs tend to put the interesting areas around the fovea or optic nerve, I think it must’ve been the optic nerve because it’s really where the vessels emerge. My best guess might be that it has something to do with blood pressure. Women have slightly more blood pressure than men in the largest caliber vessel would be the best place to observe that.
- williesleg 6y agoBut what about all 57 genders?
- riahi 6y agoThe lab I was affiliated with published a similar paper on gender dimorphism for pediatric hand and wrist radiographs in 2018. The experience of working on that paper made me realize saliency/class-activation maps are only really useful if you want to know where an object is in the image, but not that helpful if you are trying to legitimately try and figure out what the AI is using to classify. I spent days looking at male and female hand radiographs + class activation maps trying to figure out what the system was using to tell the genders apart. I never figured it out. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6646498/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6646498/
- samatman 6y agoThis isn't necessarily surprising. Maybe clinicians can be trained to get good at it, but, maybe they can't. Back before computers beat Go, the conventional wisdom was that it was a hard target because humans can leverage their pattern-finding systems to prune the state space much more efficiently than computers can. Which got me thinking: what about a game that's the opposite? Like the game's state space is embedded in the timbre of a complex tone, and you make moves by twiddling three or four knobs. It doesn't have to be a very complex game for computers to do a lot better at this, extracting meaning out of white-ish noise is not something we're good at. Assuming this isn't a data artifact, it might be one of those cases. Some pattern in the brachiation of the veins or the placement of the rod and cone cells, which just looks like noise to us, but which an ML algorithm can find and use to separate male and female retinas. There's no reason to think that humans would ever get very good at that, although I never count humans out given examples like chicken sexing[0], a notoriously opaque skill which people can nonetheless acquire, despite having little facility in explaining to others how they do it. [0]: https://en.wikipedia.org/wiki/Chick_sexing#Cultural_references https://en.wikipedia.org/wiki/Chick_sexing#Cultural_referenc...
- starchild_3001 6y agoI remember a debate a couple of years ago where some woke scientists were arguing men and women brains are indistinguishable. Others were saying there are distinguishing features. This kind of analysis may put an to that debate. Edit: This has been already done. 93% accuracy reported. Though this number may need to be verified. https://www.frontiersin.org/articles/10.3389/fnins.2019.00185/full https://www.frontiersin.org/articles/10.3389/fnins.2019.0018...
- wizzwizz4 6y agoProbably measures some skull shape features; lots of other bones are so distinguishable.
- sinuhe69 6y agoClinicians are not aware of the distinct retina features because they don’t need to. Everybody can know the sex on the first sight and when in doubt, they simply can ask. I’m certain ML would reveal other hidden, obscure features like this in the future. But that does not mean machine can do some thing people can not as the title might suggest. If people can set their mind to it, they will do. Maybe in much slower pace but they do.