7 ms·
I replied to LeCun's claims about their latest protein structure predictor and he immediately got defensive. The problem is that i'm an expert in that realm an
by dekhn 4y ago
I replied to LeCun's claims about their latest protein structure predictor and he immediately got defensive. The problem is that i'm an expert in that realm and he is not. My statements were factual (pointing out real limitations in their system along with the lack of improvement over AlphaFold) and he responded by regurgitating the same misleading claims everybody in ML who doesn't understand biology makes. I've seen this pattern repeatedly.
It's too bad because you really do want leaders who listen to criticism carefully and don't immediately get defensive.
- geertj 4y agoInteresting. What would be one of those factual statements given your expertise in the area that the ML folks don't understand?
- dekhn 4y ago"Improved protein structure prediction will speed up drug discovery"
- melling 4y agoExplaining why this won’t happen is the obvious follow up question. When is “improved structure prediction” useful or important? Often a process is simplified or distilled down to a sound bite for the general population. Then we simply repeat without understanding the details.
- dekhn 4y agoImproved structure prediction is mainly useful in hypothesis generation when doing hypothesis-driven science (IE, you want to confirm that a specific part of a protein plays a functional role in a disease). Its also a nice way to think creatively about your protein of interest. THe problem is those distilled soundbites get learned by the next generation and they try to apply it. At least I will give AlphaFold/DM credit for correcting their language - originally they claimed AF solved protein folding, but really, it's just a structure predictor, which is an entirely different area. Unfortunately, people basically taught computer scientists that the Anfinsen Dogma was truth. I fell for this for many years.
- warinukraine 4y agohttps://en.wikipedia.org/wiki/Anfinsen%27s_dogma https://en.wikipedia.org/wiki/Anfinsen%27s_dogma > It states that, at least for a small globular protein in its standard physiological environment, the native structure is determined only by the protein's amino acid sequence. Seems like "no true scotsman". If you present a counter example, they'll go "but this is only true for "small", the one you gave me isn't small.
- dekhn 4y agoLet's say you have a pool of smart first year grad students you want to inspire to work hard on problems for you for the next 7 years. Do you say "we're going to give you a problem that is unsolved but likely has a general solution, and you have a chance of making progress, publishing, and moving on to a postdoc" or do you say "THis is an impossibly hard problem and you will only make a marginal improvement on the state of the art because the problem space is so complex and large"? You say the first because it gets the students interested and working on the problem, only to learn many years later that the simplified model presented was so simplified it wasn't helpful. I fell for that and spent years working on drug discovery, structure prediction, etc, only to realize: while what Anfinsen said was true, it only applies to about 1% of protein space. It's not so much a "no true scotsman" as "some scotsmen wear quilts, and others have beards, but neither of those is sufficient to classify an example as scots".
- alextheparrot 4y agoThe core caveat being the yield of “improved … prediction” in the future tense, I assume? Given that improved structures has sped up drug discovery, I can see where the mistake is made (X has improved Y, therefore X will improve Y)
- ProjectArcturis 4y agoIt won't? AI-powered drug screening has definitely been overhyped, but in the longer term highly accurate protein structure modelling should let us understand protein-protein interactions and provide new opportunities for intervention.
- dekhn 4y agoThat has been a long-stated claim in the field that has repeatedly not shown to be useful in any sort of "engineering" or "medical treatment" sense.
- gameman144 4y agoHrmm, I think I was expecting a different type of disagreement when you said he was wrong on facts. I'm sure you know your stuff, and that you have a lot of experience with proteins that haven't helped with drug discovery or engineering, but it sounds like this is indeed a mismatch between predictions rather than facts. It very well could be the case that speeding up certain problems by multiple orders of magnitude really does help with drug discovery, and this isn't factually inconsistent with the fact that solving those problems hasn't turned out to be useful so far in this area.
- lesuorac 4y agoIf you can discover a drug faster and that drug is as useful as dirt does it matter? This isn't my field but I could grab a bunch of random jars off a shelf and pour them into capsules. No matter how fast I can do this won't improve medical outcomes for patients.
- dekhn 4y agoyou just described how modern high content screening, which has been one of the most useful techniques for finding drug leads, works. Since lead-finding is a bottleneck in the drug discovery process, it has been highly effective because it can measure things that are not currently computationally accessible.
- short_sells_poo 4y agoI feel we are at crypto/blockchain levelof hype int ML and basically the old saying of "if you are a hammer, everything looks like a nail" applies. For someone who dedicated their career to ML, they'll naturally try to solve everything in that framework. I observe this in every discipline that falls prey to it's own success. If there's a problem, those in the industry will naturally try to solve it with ML, often completely ignoring practical considerations. Is the engine in your car underperforming? Let's apply ML. Has your kid bruised their knee while skating? Apply ML to his skating patterns. The one saving grace of ML is that there are genuinely useful applications among the morass.
- kspacewalk2 4y agoSame thing with making wildly optimistic claims about "obsoleting human radiologists in five years", made more than five years ago by another AI bigwig Geoffrey Hinton. They are doubtless brilliant researchers in their field, but they seem to view AI as a sort of cheat code to skip the stage where you actually have to understand the first thing about the problem domain to which it is applied, before getting to the "predictions about where the field is going". Very similar to crypto evangelists boldly proclaiming the world of finance as obsolete. Rumours of you understanding how the financial system works were greatly exaggerated, my dudes.
- civilized 4y agoThe tribal thesis in the AI world seems to be that AI workers don't need subject matter expertise, as the AI will figure it out during training. In fact, subject matter expertise can be a negative because it's a distraction from making the AI good enough to figure it out on its own. This assumption has proven to be very fragile, but I don't think the AI bigwigs have accepted that yet. Still flush from the success of things like AlphaZero, where this thesis was more true.
- howlin 4y agoThere are a lot of problems that arise from lack of domain expertise, but they can be overcome with a multidisciplinary team. The biggest defeating problem for pure AI teams is that they don't understand the domain well enough to know if their data sets are representative. Humans are great at salience assessments, and can ignore tons of the examples and features they witness when using their experience. This affects dataset curation. When a naive ML system trains on this data, it won't appreciate the often implicit curation decisions that were made, and will thus be miscalibrated for the real world. A domain expert can offer a lot of benefits. They could know how to feature engineer in a way that is resilient to these saliency issues. They can immediately recognize when a system is making stupid decisions on out of sample data. And if the ML model allows for introspection, then the domain expert can assess whether the model's representations look sensible. I'm scenarios where datasets actually do accurately resemble the "real world", it is possible for ML to transcend human experts. Linguistics is a pretty good example of this.
- warinukraine 4y agoML people are the ultimate generalists. They claim to make tools which are domain agnostic, but they can't really validate that for themselves because they have no domain knowledge about anything.
- bjelkeman-again 4y agoCould you share the critical feedback you gave? I am interested as someone who works with biological systems and is curious about how ML can or cannot help.
- dekhn 4y agoI told him that: the increased speed but lower accuracy of their protein structure predictor was not useful because the only thing that matters in PSP is absolute prediction quality. And that speeding up that step wouldn't have any impact on pharmaceutical development, which is one of his claims (closed-loop protein design).
- fooker 4y agoWithout being an expert in this matter, this seems wrong. Sure you want quality here but there’s always going to be a human in the loop for this kind of work. Any workflow with a human in the loop has this speed vs accuracy tradeoff. While I’m not saying that speed trumps accuracy here, I don’t think you can dismiss without evidence that the tradeoff exists and speed might have benefits.
- mattkrause 4y agoIt's Amdahl's Law. Lab work and clinical trials are incredibly slow. A single experiment testing a single candidate might take weeks (in cell lines), months (rodents) or even years (humans/non-human primates). You're going to do a bunch of them and they often require expensive reagents and/or tedious work. Consequently, shortening the wait for a predicted structure by a few hours (or days) won't really move the needle. This is especially true if it makes your experiment, already probably a long shot, less likely to succeed.
- balsam 4y agoGP is saying that the slow part of pharmaceutical development (synthesis,trials,etc) takes so many orders of magnitude longer than the software part (candidate generation) that any speed improvement is moot. In fact having lower quality software generated candidates merely leads to wasted time later.
- nn3 4y agoSo what would constitute him not "getting defensive"? He's supposed to agree with you, or not express an opinion? Anything else short of this would be "defensive" right? This whole idea that defending your positions in arguments is somehow a bad thing is a really odd modern development that I never understood.
- PuppyTailWags 4y agoTBH I think even a basic "I considered your point, but X and Y factors seemed to mitigate it enough for my standards, defined by P and Q. Let me know if I'm misunderstanding anything" would do a lot. It's important to always show you've considered that you're wrong about something.
- searine 4y agoThe correct response to a criticism you disagree with is "thanks".
- trap_goes_hot 4y agoYou're right. That response is sufficient for people who provide it in good faith. There are bad faith actors who aren't happy unless you actually respond in detail and convince them otherwise. They're more than happy to raise a ruckus about how "XYZ ignored my feedback and criticism".
- searine 4y agoThanks.
- Barrin92 4y agoI'm not sure what OPs particular point was, but Yan seemed to argue over and over again that testing Galactica with adversial inputs is why "we can't have nice things" which to me seems not just defensive but kind of comical. Any AI model needs to be designed with adversarial usage in mind. And I don't even think random people trying to abuse the thing for five minutes to get it to output false or vile info counts as a sophisticated attack. Clearly before they published that demo Facebook had again put zero thought into what bad actors can do with this technology and the appropriate response to people testing that out is certainly not blaming them.
- LegitShady 4y agoI think it makes sense when you realize that the product (Galactica) and all the messaging around it are just PR - they're communicating to shareholders of a company in deep decline trying to say 'look at the new stuff we're doing, the potential for new business here'. You interrupting the messaging ruins it, so you get some deniable boilerplate response. its not personal.
- vishnugupta 4y agoWithout even opening the link I half expected it to be about LeCun and I want wrong. Him and Grady Booch recently had a back and forth on the same subject on Twitter where to me it seemed like he couldn’t answer Booch’s very basic questions. It’s interesting to see another person with a similar opinion.
- thenightcrawler 4y agoIs this on twitter, please link if so
- deleted 4y ago[deleted]
- regnull 4y agoI feel that if you make a claim like this, you should link to the full text of your exchange.
- dekhn 4y agoI had to do some searching but it looks like he deleted his replies to my comments and that caused my own subsequent comments to be deleted? https://www.linkedin.com/posts/yann-lecun_esm-metagenomic-atlas-an-open-atlas-of-617-activity-6993285836372897795-LKz2 https://www.linkedin.com/posts/yann-lecun_esm-metagenomic-at...
- uJustsaidit 4y agoBut we gave the keys to the economy to some vain children who have never had to do real work to make a name for themselves. Straight from uni being librarians assistants to the elders, straight to running the world! Society is still led by vague mental imagery and promises of forever human prosperity. The engineering is right but no one asks if rockets to Mars are the right output to preserve consciousness. We literally just picked it up because the elders started there and later came to control where the capital goes. We’re shorting so many other viable experiments to empower same old retailers and rockets to nowhere.
- theptip 4y agoIt's tough because I think he has a really difficult job in many regards; Meta catches so much unjustified flak (in addition to justified flak) that being a figurehead for a project like this has to be exhausting. Being constantly sniped at probably puts you in a default-unreceptive state, which makes you unable to take on valid feedback, as yours sounds like.
- wpietri 4y ago> It's too bad because you really do want leaders who listen to criticism carefully and don't immediately get defensive. For sure. If this is how he treats outside experts, I can't imagine what it's like to work for him. Or rather, I can imagine it, and I think it does a lot to explain the release-and-panicked-rollback pattern.
- Simon_O_Rourke 4y agoI'm delighted you called out these problems when you came across them, and sorry that he didn't have the grace or maturity to take it on board without getting defensive. Like many thin-skinned hype merchants with a seven-figure salary to protect, they're going to try and block criticism in case it hits them in the pocket. Simple skin in the game reflex that will only hurt any chances of improvement.
- musicale 4y ago> I replied to LeCun's claims about their latest protein structure predictor and he immediately got defensive Ideally scientists would be interested in the truth and engineers would be interested in making the system better.
- fmajid 4y agoAt some level he must know (AI) winter is coming along with the recession, which is why he is so defensive, as if a barrage of words will stave off the inevitable.