18 ms·
Chief scientist of major corporation can’t handle criticism of the work he hypes
- michele_f 4y agoGary Marcus built almost entirely his public reputation (which is positively correlated with his income) by antagonizing whatever Deep Learning scientist he could reach. He speaks badly about people that worked hard with their hands, brains and souls to make incredibly complex things happen. Yann Lecun, which I personally met a couple of times, is in a way another sort of typical character: the ever-childish researcher that likes money a lot, to the point of accepting a prestigious role in one of the most deplorable companies in the modern world (at least from an ethical perspective). He also like attention and public display of status: he can’t resist to pick a fight with Gary. From a pure research perspective he’s long dead. The question is: do we have enough of those two? Can we move on? Thanks.
- PaulHoule 4y agoI was working for somebody once who seemed to think LeCun was an uninspired grind and I'm like no, LeCun won a contest to make a handwritten digit recognizer for the post office. LeCun wrote a review paper on text classification that got me started building successful text classifiers and still influences my practice. LeCun is one of the few academics who I feel almost personally taught me how to do something challenging. But the A.I. hype is out of hand. "A.I. Safety" research is the worst of it, as it suggests this technology is so powerful that it's actually dangerous. The other day I was almost to write a comment on HN to a post from lesswrong where they apologized at the beginning of an article critical of the intelligence explosion hypothesis because short of Scientology or the LaRouche Youth Movement it is hard to find a place where independent thought is so unwelcome. Let's hope "longtermism" and other A.I. hype goes the way of "Web3".
- c1ccccc1 4y ago> it is hard to find a place where independent thought is so unwelcome. Is that actually true, though? It's true that a higher fraction of the people in that community give credence to the intelligence explosion hypothesis than pretty much anywhere else. (This is what one would expect, since part of the purpose of LessWrong is to be a forum for discussions about super-intelligent AI.) But even if the intelligence explosion is a terrible, absolutely-wrong theory, that doesn't prevent the people who hold it from being open-minded and tolerant of independent thought. Willingness to consider new and different ideas is something the LessWrong community claims to value, so it would be a little bit weird if they were doing way worse than average at it. And AFAICT, it seems like they're doing fine. Some examples: - Here [1] is a post critical of the intelligence explosion theory. It has 81 upvotes as of this writing, and the highest upvoted comment goes like: "thanks for writing this post, it makes a lot of good arguments. I agree with these things you wrote" (list of things) "here are some points where I disagree" (list of things). This may even be the original post you were talking about in your comment, except that it doesn't start with an apology. - LW has 2 different kinds of voting: "Regular upvotes" provide an indication of the quality of a post or comment, and "agree/disagree votes" let people express how much they agree or disagree with a particular comment. Down-voting a high quality comment just because you disagree (instead of giving it a disagree-vote) would be against the culture on LW. If you're already sure that LW is wrong about superintelligence, and you're trying to explain how they became wrong, then "those LW people were too open minded and fell for that intelligence explosion BS" makes more sense to me than anything about suppression of independent thought. [1] https://www.lesswrong.com/posts/zB3ukZJqt3pQDw9jz/ai-will-change-the-world-but-won-t-take-it-over-by-playing-3 https://www.lesswrong.com/posts/zB3ukZJqt3pQDw9jz/ai-will-ch...
- lupire 4y agoAI Safety is important, but the unsafety isn't from the superintelligrnt AI, it's from dumb and cruel people hiding behind it as an excuse for their misbehavior.
- PaulHoule 4y agoIt's like automotive safety, safety driving a forklift, etc.
- MonkeyMalarky 4y agoWeapons of Math Destruction is good book on the topic. Using ML to do tasks like evaluate employee performance (and trigger firings), issue loans, insurance etc. is affecting peoples lives in the real world today.
- dekhn 4y agoInsurance has always been a statistically driven process and ML is just an advanced form of stats, so it makes perfect sense that the industry should use this technology.
- twobitshifter 4y agoI know of models that use things like typing speed and birth month to make loan decisions. Feed the AI inputs like race and it will make racist decisions.
- MonkeyMalarky 4y agoFeed a model zipcode information and you've got a pretty decent proxy for race too.
- dekhn 4y agoI am not aware of models that use birth month to make loan decisions, but if that's a useful predictor, why not include it? I'm not really sure exactly what you mean by "feed AI inputs like race and it will make racist decisions", as that's an absurdly general claim that doesn't even really say anything useful. If you mean the model reflects the underlying stats that correlate with race, class, gender, then sure, yes, I agree the predictor will do that. To say that it's racist is an entirely subjective claim. THe point of insurance isn't to avoid social ills, but to statistically minimize the impact of risk on individuals (while making a tidy profit for the insurer).
- cultureulterior 4y agoAI isn't dangerous now. But it will be.
- naasking 4y ago> But the A.I. hype is out of hand. "A.I. Safety" research is the worst of it, as it suggests this technology is so powerful that it's actually dangerous. It boggles my mind how anyone can think otherwise. Existential dangers of superintelligent or even non-intelligent AI are the long-term result of the dangers of AI being developed and misused over time for human ends. It's the exact same argument behind why we should be trying to track asteroids, or why we should be trying to tackle climate change: the worst-case scenario is unlikely or in the future, but the path we're on has numerous dangers where suffering and loss of human life is virtually certain unless something is done.
- thesuperbigfrog 4y ago>> the path we're on has numerous dangers where suffering and loss of human life is virtually certain unless something is done What sort of AI catastrophe do you think would happen?
- naasking 4y agoThat's akin to asking "what sort of human catastrophe do you think would happen?" A whole host of things are possible in principle on a long enough timeline. If you constrain the timeline, then you'll get more plausible answers but with potentially wide error bars because we don't really understand what "intelligence" really is, ie. current research could be pretty close but could also be pretty far from it. The fact that we don't know how close we are is itself dangerous. It's like doing gene editing on pathogens without a proper understanding of germ theory and biosafety. That's where we are with AI.
- michaelt 4y ago> It boggles my mind how anyone can think otherwise. Some AI dangers are certainly legitimate - it's easy to foresee how an image recognition system might think all snowboarders are male; or a system trained on unfair sentences handed out to criminals would replicate that unfairness, adding a wrongful veneer of science and objectivity; or a self-driving car trained on data from a country with few mopeds and most pedestrians wearing denim might underperform in a country with many mopeds and few pedestrians wearing denim. But other AI dangers sound more like the work of philosophers and science fiction authors. The moment people start predicting the end of humans needing to work, or talking about a future evil AI that punishes people who didn't help bring it into existence? That's pretty far down in my list of worries.
- bondarchuk 4y ago>But the A.I. hype is out of hand. "A.I. Safety" research is the worst of it, as it suggests this technology is so powerful that it's actually dangerous. The other day I was almost to write a comment on HN to a post from lesswrong where they apologized at the beginning of an article critical of the intelligence explosion hypothesis because short of Scientology or the LaRouche Youth Movement it is hard to find a place where independent thought is so unwelcome. I hesitate to say "safe space", but... what if a group of people wants to come together discuss AI safety? If they'd have to regurgitate all the arguments and assumptions for everyone who comes along they'd never get anything done. If you are really interested to know where they are coming from, you can read the introductory materials that already exist. If the 99.9% of the world is hostile towards discussing AI safety (of the superintelligence explosion kind, not the corporate moralitywashing kind) there is some value in a place which is hostile to not discussing it, so that at least those interested can actually discuss it.
- thwayunion 4y agoThe most aggrivating thing about EA "longtermism" AI Safety stuff is that is takes the oxygen out of the room for actual AI safety research. Using ML for object detection, object tracking, or prediction on an L2-L5 driver assistant system? AI safety research sounds like a capability you'd really want. Using ML for object detection, object tracking, or prediction on an industrial robot that is going to work alongside humans or could cost $$$ when it fails? AI safety research sounds like a capability you'd really want. Using classifiers or any form of optimization for algorithmic trading? AI safety research sounds like a capability you'd really want. Building decision support systems to optimize resource allocation (in an emergency, in a data center, in a portfolio, ...)? AI safety research sounds like a capability you'd really want. Hell, want to use an LLM as part of a customer service chatbot? You probably don't want it to be hurling racial slurs at your customers. AI safety research sounds like a capability you'd really want. Unfortunately, now "AI Safety" no longer means "building real world ML systems for real world problems with bounds on their behavior" and instead means... idk, something really stupid EA longtermism nonsense.
- ethanbond 4y agoYou just listed 5 completely distinct applications of AI safety (and surely can name countless others) and then concluded with a complaint that the concept of AI safety is not well-defined? The whole point is that the technology itself and its capabilities are not well defined, people are constantly inventing new applications and new methods now at breakneck speed, so the question of how to mitigate its risks is going to be at least as squishy a concept as the underlying tech + applications.
- thwayunion 4y agoRight, that's the problem. Before 2016 or so, "AI Safety" meant the types of things I listed above: how to design AI systems that are safe to use in safety-critical settings. Unfortunately, the term "AI Safety" has been overrun with effective altruist longtermism folks talking about something closer to https://en.wikipedia.org/wiki/Existential_risk_from_artificial_general_intelligence https://en.wikipedia.org/wiki/Existential_risk_from_artifici... which is ill-defined and, frankly, usually completely vapid nonsense. > so the question of how to mitigate its risks is going to be at least as squishy a concept as the underlying tech + applications. No, no, no!!! AI safety methods -- methods that really increase confidence in real systems -- are not generic. ALL of the useful AI safety work I know of is deeply related to one or more of: the specific model architecture, the specific optimization algorithm, the specific data, or the specific application. Almost always all of the above.
- scifibestfi 4y ago"A.I. Safety" is a proxy for a battle over control of what kind of output or inquiry should be allowed at all. Suffice it to say, ideologues desperately want control over everything AI/ML. That's the real danger.
- creatonez 4y ago> "A.I. Safety" research is the worst of it, as it suggests this technology is so powerful that it's actually dangerous Well that's an interesting way to misrepresent an entire important field of research based on what a few idiots said. There are serious people in that field who aren't addicted to posting on LessWrong.
- logicalmonster 4y agoI'm not super familiar with the state of the art technology in this space and how these demos were presented, but I think all of these conflicts seem like they should be resolved if companies just put gigantic honking disclaimers on the work these AI tools produce. If you wrote a flashing big red warning, something like the following, couldn't everybody be satisfied? "CAUTION. This technology is still very early and may produce completely incorrect or even dangerous results. Any output by this tool should be considered false and is only suitable for entertainment purposes until expert human judgement verifies the results."
- adamsmith143 4y ago>If you wrote a flashing big red warning, something like the following, couldn't everybody be satisfied? "CAUTION. This technology is still very early and may produce completely incorrect or even dangerous results. Any output by this tool should be considered false and is only suitable for entertainment purposes until expert human judgement verifies the results." I'll give you the benefit of the doubt since the demo is now offline but there was in fact a giant disclaimer that said more or less: "DO NOT TRUST THE OUTPUT OF A LANGUAGE MODEL WITHOUT VERIFICATION."
- mattkrause 4y agoIt did...but it also said stuff like "ACCESS ALL OF HUMANITY'S KNOWLEDGE!!!" They were trying to have it both ways, where the headline giveth and the fine print taketh away. In a better world, this could have been released as "We trained a language model on the scientific literature. We're excited because it is starting to draw conclusions, but there is obviously a lot more to be done. See our evaluation here. Have fun and let us know what you find." The hype is really annoying and seems bizarre--everyone who even remotely cares knows about Meta already.
- tsimionescu 4y agoThat was only present on the bottom half of the "Mission" page - the main page and other pages were full of examples of all the marvelous things it can do (that it can't really do reliably) [0]. https://web.archive.org/web/20221116161353mp_/https://galactica.org/ https://web.archive.org/web/20221116161353mp_/https://galact...
- adamsmith143 4y agoYann LeCun has lots of faults, certainly with how he treats AI safety in general, but a lot of the criticism he got was saying "He's not qualified to be in the position he is in" which is actually absurd if you know anything about him. Even if you knew nothing other than the fact that he won a Turing Award then he would be qualified for basically any computing/AI/ML job on the planet. \ Also the title of this post is deliberately inflammatory. Should be more like "Head of team that spent months building complex ML system annoyed when people spend undue amounts of time criticizing it."
- logicchains 4y ago>"Head of team that spent months building complex ML system annoyed when people spend undue amounts of time criticizing it." What's undue about it? If a team spent months producing a webapp that failed to live up to its claims and was full of security vulnerabilities and inaccuracies, nobody'd expect anyone to moderate their criticism of it. Having a Turing award doesn't mean somebody can't deliver a shit product, and I don't see why it should make them more above criticism than anyone else who delivered something similar.
- mattkrause 4y agoI don't think anyone is really "qualified" to have the level of influence, power, and adoration that the very top names in many fields get. Research "success" certainly takes some talent and LeCun is certainly smart. However, exhibiting that talent also needs luck, timing, and connections, all of which are subject to crazy positive feedback loops: getting an award helps you get subsequent awards, better students, etc. In a world where GPGPUs came a little sooner or later, I think we'd have totally different "superstars".
- seydor 4y agoThis is academic TMZ Lecun implied on twitter that they 'll get it back. I really hope so
- tiahura 4y ago
- dekhn 4y agoI replied to LeCun's claims about their latest protein structure predictor and he immediately got defensive. The problem is that i'm an expert in that realm and he is not. My statements were factual (pointing out real limitations in their system along with the lack of improvement over AlphaFold) and he responded by regurgitating the same misleading claims everybody in ML who doesn't understand biology makes. I've seen this pattern repeatedly. It's too bad because you really do want leaders who listen to criticism carefully and don't immediately get defensive.
- geertj 4y agoInteresting. What would be one of those factual statements given your expertise in the area that the ML folks don't understand?
- dekhn 4y ago"Improved protein structure prediction will speed up drug discovery"
- melling 4y agoExplaining why this won’t happen is the obvious follow up question. When is “improved structure prediction” useful or important? Often a process is simplified or distilled down to a sound bite for the general population. Then we simply repeat without understanding the details.
- dekhn 4y agoImproved structure prediction is mainly useful in hypothesis generation when doing hypothesis-driven science (IE, you want to confirm that a specific part of a protein plays a functional role in a disease). Its also a nice way to think creatively about your protein of interest. THe problem is those distilled soundbites get learned by the next generation and they try to apply it. At least I will give AlphaFold/DM credit for correcting their language - originally they claimed AF solved protein folding, but really, it's just a structure predictor, which is an entirely different area. Unfortunately, people basically taught computer scientists that the Anfinsen Dogma was truth. I fell for this for many years.
- canjobear 4y agoBased on this post and others, Andrew Gelman seems to be hostile to DL. Why is that the case? Is it because it’s not Bayesian?
- j7ake 4y agoBecause many people think DL is overhyped as an automatic solver of all problems.
- deleted 4y ago[deleted]
- bumholio 4y agoExpecting Galactica to produce truthful academic papers is just about as sensible as expecting to find a significant other among your kitchen appliances. Language models are a way to emulate the writing style of human produced content, only a fool would expect them to reason about the text to any level resembling a scientific standard. Written language is a doorway to the full extent of human cognition; unless the problem domain is severely constrained (ie "What is the distance to Mars?"), you are very likely to fall into reflexive traps that rapidly devolve into AGI ("I think, therefore I am?").
- themoonisachees 4y agoThe issue isn't that the model isn't truthful, it's that it is effective at writing language that appears factual and looks truthful to the untrained eye. Sure, it is going to give you what you're asking for, but the issue come when you take that and give it without warnings as to its origins to people who can't be expected to fact-check a scientific article.
- hack-ernews 4y agoYou don't need AI to fool people who can't understand a scientific article yet will trust its conclusions.
- themoonisachees 4y agoTrue, but AI significantly increases the throughput and ease at which it can be done.
- deleted 4y ago[deleted]
- LLMscientist 4y agoThis is a good title because it succinctly captures the issue: LeCun hyped this work by making wildly inaccurate claims and cherry picking model outputs. Go read his original tweets about the model's capabilities. Read Facebook's own characterization of what this model could achieve. Not only did they exaggerate and hype, but they also didn't even try to solve some of the most glaring issues. The efforts on toxicity mentioned in their paper aren't even mid. They barely put effort into measuring the issue, and definitely didn't make any attempt to mitigate or correct. Toxicity isn't really the point. Here's the point. If you can't prevent a model from being overtly toxic, then why should I believe you can give any guarantee at all about the model's output? I shouldn't, because you can't. Galactica is just another a language model. It can be a useful tool. Facebook and LeCun oversold its capabilities and downplayed its issues. If they had just been honest and humble, things would've probably gone very differently. In some sense, this is good news. The deep learning community -- and generative model work in particular -- is getting a much-needed helping of humble pie. Hopefully we can continue publishing and hosting models without succumbing to moral panic. But the first step toward that goal is for scientists to be honest about the capabilities and limitations of their models. ---- My account is new so I am rate limited and unable to reply to replies. My response to the general vibes of replies is therefore added to the above post as an edit. Sorry. Response about toxicitiy: It's a proxy that they say they care about. I can stop there, but I'll also point out: it's not just "being nice", it's also stuff like overt defense of genocide, instructions for making bombs, etc. These are lines that no company wants their model to cross, and reasonably so. If you can't even protect Meta enough to keep the model online for more than a day or two, then why should I believe you can give any guarantee at all about the model's output in my use case? (And, again, they can't. It's a huge problem with LLLMs) Response about taking the model down: I'm not at FB/Meta, but I think I know what happened here. In the best case, Meta was spending a lot of valuable zero-sum resources (top of the line GPUs) hosting the model. In the worst case they were setting a small fortune on fire at a cloud provider. Even at the largest companies with the most compute, there is internal competition and rationing for the types of GPUs you would need to host a Galactica-sized model. Especially in prototype phase. An executive decided they would rather pull the plug on model hosting than spend zero-sum resources on a public relations snafu with no clear path to revenue. It was a business decision. The criticism of Galactica and especially the messaging around it was totally fair. The business decision was rational. Welcome to private sector R&D; it works a little different from your academic lab for better and for worse.
- awillen 4y agoHere's what I (a person with a fairly superficial understanding of how AI works, for context) can't understand - why wouldn't it have been trivial to prevent the kinds of issues that arose by just training the thing to only pull information from scientific papers/literature, and when a question arose on a topic that didn't have information in those places just say "we can't find enough information about that topic"? It seems like it was good at structuring the writing, both at the article and sentence levels, and for valid prompts it produced accurate responses. But if you entered "write a wiki article about the Alien vs. Predator hypothesis," it would structure it like a wiki article about a scientific topic but just put random AVP stuff it found on the internet into that structure. Why couldn't they just explicitly define which sources are appropriate to pull information from? That seems easier to me than building the actual product they made (but again, I am a layman here).
- glitchc 4y agoBecause training in this manner requires good data. And by good I mean manually curated. The ML hype train relies on "garbage in, good out", popularized by an influential paper published at the turn of the century [1]. Anyone with a modicum of experience in experimental science knows that any experiment is only as successful as its ability to collect good data that is representative of the problem, has manageable noise based on known controlled sources and has sufficient coverage of the problem domain to provide meaningful analysis. But of course, if ML admitted that this was a necessary requirement, it would become yet another optimization technique, admittedly new classes of optimization techniques and that promise that the machine learns something new would fall flat on its face. [1] https://aclanthology.org/H01-1052.pdf https://aclanthology.org/H01-1052.pdf
- awillen 4y agoSure, I get that part, but in this case it seems like curation (at least to a degree that would avoid the problems that arose) is fairly trivial - just train it on high-quality scientific journals/textbooks/etc., instead of letting it peruse the whole internet (or whatever they did) for scientific data.
- 4y ago
- robg 4y agoFrom the title I knew it was about LeCun. Why does it seem like Meta’s culture is riven by sycophants who are unable or unwilling to make work better through criticism?
- gtmitchell 4y agoAs a bright-eyed science undergraduate, I went to my first conference thinking how amazing it would be to have all these accomplished and intelligent people in my field all coming together to share their knowledge and make the world a better place. And my expectations were exceeded by the first speaker. I couldn't wait for 3 full days of this! Then the second speaker got up, and spent his entire presentation telling why the first person was an idiot and totally wrong and his research was garbage because his was better. That's how I found out my field of study was broken into two warring factions, who spent the rest of the conference arguing with each other. I left the conference somewhat disillusioned, having learned the important life lesson that just because you're a scientist doesn't mean you aren't also a human, with all the lovely human characteristics that entails. And compared to this fellow, the amount of money and fame at stake in my tiny field was miniscule. I can only imagine the kinds of egos you see at play among the scientists in this article.
- kache_ 4y agoThis is why industry > academia, imo. At the end of the day, all of the noise of negativity and bad press is being drowned out by incredible demos. I don't know what to chalk this up to if not jealousy. Most people in the ML-o-sphere are ignoring it. At the end of the day, all that matters is: are users using what you built?
- mynameisvlad 4y agoI mean.... That matters to someone in the industry, yes. But not necessarily someone in academia. You chose industry over academia, and that's fine. It lines up with your values. But realize that not everyone shares those values and beliefs. To some, the act of discovering a new thing is much more important than the users using said discovery. And that lines up with academia more so than the industry. Both are different. Both are valid.
- brankoB 4y agoNone of it would be possible without academia though. Industry just applies academic research.
- kowlo 4y agoNo surprise. Need to ride the funding train for as long as they can.
- hack-ernews 4y agoHe received the Turing award for his work on neural networks; no big deal.
- logicchains 4y agoI thought it was "he received the Turing award for Schmidhuber's work on neural networks": https://people.idsia.ch/~juergen/critique-turing-award-bengio-hinton-lecun.html https://people.idsia.ch/~juergen/critique-turing-award-bengi...
- deleted 4y ago[deleted]
- megaman821 4y agoI kinda agree with LeCun here. Why can't companies and people just put out cool things that have faults? Now we have a tool that got pulled, not because any concrete harm, only outrage over theoretical harm. It is not the tool, not the people finding faults, but people reaction's that seem like they have gone too far.
- kspacewalk2 4y ago>Why can't companies and people just put out cool things that have faults? Absolutely they can, and his employer could have kept it up. The issue is the phantasmagorical and ridiculous claims about AI-generated scientific research that LeCun peddles. When there's something concrete one can use to test these extremely bold claims, there's a way to at least partially apply a reality check to the claims, and demonstrate their ridiculousness. Which is a very useful and important part of how the scientific field evolves and advances. Feeding non-experts all these wild claims in perpetual future tense only works for so long, and it ought to be that way.
- alpaca128 4y ago> In the company’s words, Galactica “can summarize academic papers, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more.” The first step to successfully publish prototypes is creating realistic expectations. That's being done all the time in papers and other ML projects. Instead Meta listed a set of features in a language model that can be summarized as "magic".
- tylerneylon 4y agoGPT-3 can already most of those things. If you haven’t spoken with GPT yourself, you might think it’s overhyped. But it really is quite amazing. I’m saying this as a 15-year veteran machine learning engineer who is not impressed by much in ML. The “hype” part of what’s happening (the disconnect between reality and the goal) is that these models do make silly mistakes. But they also can actually perform the operations on the list above, and not in some “works 1% of the time” sense. This kind of AI is at a turning point, becoming deeply impressive and significantly expanding what code can do.
- Cyberdog 4y ago> and generated wiki articles about the history of bears in space as readily as ones about protein complexes and the speed of light. It’s easy to spot fiction when it involves space bears, but harder with a subject users may not know much about. Well, that matches our current experience with human-written Wikipedia articles pretty closely then.
- ispo 4y agoBut I enjoyed it with its niceties and oddities!
- eurasiantiger 4y agoCave Johnson, is that you? Life imitates art imitates life.
- MikeTheGreat 4y agoI came here just to ask: Could someone rewrite the HN title of this post? Currently it feels really clickbait-y. One of the things I really like about HN is the _lack_ of clickbait titles. Some titles are more informative, some less, but overall I feel like the titles are clear, to the point, and not carefully crafted/engineered to poke the lizard part of my brain in the way that clickbait titles are. Disclaimer: I haven't read the article so I can't propose a title myself. And with a title like this I'm not going to.
- ChrisMarshallNY 4y agoI have to agree. This is not my bailiwick, and, for all I know, the title is accurate, but it is jarring. I feel as if this is a professional venue, so I try to behave professionally (even though I'm not really looking for any work).
- seydor 4y agoIt's a flamebait article with a clickbait title, another title would be less fitting
- notpachet 4y ago"Large Language Model Professors HATE Him!" https://truthinadvertising.org/articles/sidebar-ad-language-professors-hate-him/ https://truthinadvertising.org/articles/sidebar-ad-language-...
- robertlagrant 4y ago"AI Professor DESTROYS haters with this weird old trick"
- tinyhouse 4y agoThe criticism that Galactica is bad is legit. The criticism that it's dangerous by the Twitter police is not. Some people are professional complainers and somehow got to high ranks in academia. That says a lot about academia in the US.
- anshumankmr 4y agoGary Marcus and Yann Le Cunn... name a more iconic duo
- LukeB42 4y ago"I guess that without outside criticism we’d all be driving cars that run on cold fusion, cancer would already have been cured 100 times over, etc." LeCun invented the convnet and may well have been writing scientific research papers since before the author of that sentence was even born lmfao
- belval 4y ago> LeCun also approvingly links to someone else who writes, in response to AI critic Gary Marcus The article really fails to explain that LeCun and Marcus have been trading insults for the last few years, it's hardly LeCun snapping at some random person.
- ak_111 4y agoI think there approach and model are interesting the problem is that they overhyped it to the point that it would be unacceptable academically. Their abstract says "In this paper we introduce Galactica: a large language model that can store, combine and reason about scientific knowledge... these results demonstrate the potential for language models as a new interface for science. We open source the model for the benefit of the scientific community." If I was a reviewer of this paper I would ask them to add (if they haven't so) significant section to the body of the paper highlighting the limitation of the model and the ways it can be misused. Including showing examples of wrong output. I would then ask them to rewrite the abstract to include something along the lines "We also highlight the limitations of the model including inability to distinguish fact from fiction in several instances and the ways it can be misused and outline some ideas on how these limitation could be mitigated or overcome in the future."
- jonstokes 4y agoI don't know LeCun personally, but there's a lot of backstory here that this polemical clickbait is leaving out. - LeCun has a history of getting mobbed by "AI ethics" types on Twitter, and in the past he was very deferential to these folks, and even left Twitter for a while. I wrote about some of that here: https://www.jonstokes.com/p/googles-colosseum https://www.jonstokes.com/p/googles-colosseum - The MIT Tech Review, which is the author's main source here apart from Twitter, is techlash rag, and they went through a long phase where they only published anti-AI stuff from the "AI ethics" people. Most of those writers I used to follow there on this topic have since moved on to other pubs, and the EIC responsible for this mess has moved on to run WIRED. But it seems they're still publishing the same kind of stuff even with new staff and management. They have exactly one and only one editorial line on AI in general and LeCun in specific, and that is "lol AI so racist and overhyped!" It's boring and predictable. - LeCun has a longstanding beef with Marcus, and the two treat each other pretty poorly in public. Marcus seems to have a personal axe to grind with LeCun. Given that Marcus has been leading the mob on this, it's not shocking that LeCun got crappy with him. - Emily Bender, Grady Booch, and the other folks cited in the MIT Tech Review piece all, to a person, have exactly one line on AI, everywhere at all times and in all circumstances, and it's the same one I mentioned above. You could code a bot with a lookup table to write their tweets about literally anything AI-related. - Yeah, LeCun is a prickly nerd who gets his back up when certain people with a history of attacking him come after him yet again. He should probably should stay chill. - "AI so overhyped" is a pose, not an argument, an investment thesis, or a career plan. But hey, you do you. Anyway, I hate to be defending anything Meta-related, but this article is slanted trash, its sources haters who have only one, incredibly repetitive thing to say about AI, and the author is a hater.
- yellow_lead 4y agoPro-AI articles are all the same as well. "AI will be so useful!" It's boring and predictable.
- jonstokes 4y agoWrong. "Here is a totally mind-blowing new thing AI will let you do this week that humanity could not do last week" is an endless source of novelty and eyeballs. Source: Am a publisher in this space and have seen the engagement numbers. You are the guy in the meme standing in the corner of the party, with the words "They don't know AI is just math" printed over his head.
- chubot 4y agoA fundamental problem with Galactica is that it is not able to distinguish truth from falsehood, a basic requirement for a language model designed to generate scientific text Isn't this the same problem that Github Copilot has? Fundamentally it has no idea whether code works. It doesn't even know what the problem is. It just spits out things that are similar to things its seen before, including buggy code from Github repositories. Not sure why it's so popular. I guess it helps you write status quo code faster (the status quo being buggy and slow) -- I would rather it help us write better code.
- KKKKkkkk1 4y agoI work with a system similar to Copilot and find it helpful. It memorizes APIs and code patterns so that I don't have to. I don't expect it to solve algorithmic problems for me. It's a better version of autocomplete, which is a feature that programmers have been using in their IDEs since the 90s.
- alexfromapex 4y agoMy impression was that it merely searched through the large collection of articles and then briefly summarized them? Maybe the bears in space output is a result of articles about water bears, i.e. tardigrade articles?
- fumeux_fume 4y agoThe title of this post should tell you everything you need to know about its bias against LeCun, but both sides are in the wrong here. Meta shouldn't be over-hyping tools that have serious problems and the anti AI bunch need to stop beating a dead horse by only judging AI's progress soley by how it can be abused.
- lopkeny12ko 4y agoThis is a highly editorialized title. Perhaps we should link to the original source instead: https://www.technologyreview.com/2022/11/18/1063487/meta-large-language-model-ai-only-survived-three-days-gpt-3-science/ https://www.technologyreview.com/2022/11/18/1063487/meta-lar... "Why Meta’s latest large language model survived only three days online"
- Tomte 4y agoYou're wrong. I omitted a single word because of HN's length restriction (that was also dismissive and doesn't contribute much).
- lopkeny12ko 4y ago
- Tomte 4y ago
- lopkeny12ko 4y ago
- Tomte 4y agoBless your heart.
- dang 4y agoIt's not ok to post flamewar comments like this, regardless of how wrong someone else is or you feel they are. If you'd please review https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting here, we'd appreciate it. Your comment would have been fine without the insults in the first two sentences. It seems clear that you and Tomte simply understand the meaning of the word "editorialize" differently. That's definitely not something to get into a spat about.
- tylerneylon 4y agoI studied machine learning at NYU, and from interacting with Yann LeCun, I can say he’s actually a nice guy. Yes, his tweet is grumpy. I still feel as if the implication that Galactica should have been taken down was the worse thing happening here. I read the MIT Technology Review article, and I was asking myself “what is an example of Galactica making a mistake?” The article could easily have quoted a specific prompt, but doesn’t. It says the model makes mistakes in terms of understanding what’s real/correct or not, but the only concrete example I see in the article is that the model will write about the history of bears in space with the implication that it’s making things up (and I believe the model does make such mistakes). I don’t think it’s a good article because it’s heavy on quoting people who don’t like the work and light on concrete details. Does the imperfection of a language model really mean the model should not exist? This seems to be what some critics are aiming for.
- opportune 4y agoIt is the same problem as with all the AI models that are “racist” (note some are actually racist or insensitive): the AI model just does what it’s told, doesn’t know right from wrong, and amplifies fake and actual differences in ways that make us uncomfortable. So you can get an AI model that hasn’t been hardened against these attacks to write a paper on why <racist thing> or create an image depicting <racist or porny thing> and it just does it. Because the model is just an input:output device and doesn’t have the “wait maybe I shouldn’t do that because it’s bad” feature. And while teen and young 20 something males will get a huge laugh out of posting screenshots of it, the journalist crowd will freak out and start calling the model, researchers, and company racist. Personally I have played with large language models and the chutzpah with which they will lie and make things up is indeed astounding (they do a good job at making them sound believable, and lie with utter seriousness and confidence). So I can see where the controversy comes from, although I agree with the other commenters that the researchers should be able to put up a bit fat disclaimer about it
- jrpt 4y agoI saw examples of people using it to generate scientific-sounding fake studies like: the benefits of eating glass, or promoting antisemitism. That being said, I am very partial to the AI researchers here who feel like their cool demo has to be taken down because some people were misusing it. It's an unfair high standard they're holding AI demos to, compared with other technologies. It's analogous to asking Alexander Graham Bell to shut down an early telephone prototype because some jerks were using it to discuss antisemitic conspiracies.
- stephc_int13 4y agoQuite a few modern technologies have followed Moore-like exponential-shaped curves with rapid improvements and commercialisation. But this relatively common pattern does not seem to work all the time. Quantum Computing, Nuclear Fusion and AI are good counter examples. Progress in those areas seems to follow a less than linear curve, much closer to a logarithm than an exponential. We can only speculate about the reasons. Are we hitting some kind of ceiling?
- A4ET8a8uTh0 4y agoHmm. Please correct me if I am misrepresenting a chain of events here. A.. tool lands that allows one use language model to generate content. People feed it false data and share that, surprise, data it produces from the data the model is based on is false. How is this a surprise? I am still not sure why Meta would pull it? It can still be useful, but it was made not useful. I am not sure what a proper metaphor is for it, but it is almost like I give you a tool ( lets say a knife ) and you complain that the tool produces bad results when drinking soup. What am I missing here? <<or maybe it [Galactica] was removed because people like you [Marcus] abused the model and misrepresented it. Thanks for getting a useful and interesting public demo removed, this is why we can’t have nice things. <<Meta’s misstep—and its hubris—show once again that Big Tech has a blind spot about the severe limitations of large language models. There is a large body of research that highlights the flaws of this technology, including its tendencies to reproduce prejudice and assert falsehoods as facts.
- cs702 4y agoLeCun's behavior here cannot be justified, but I think it's partially explained by his background. LeCun's life experience has taught him that when others criticize his work again and again and again, he should ignore them and persist if he thinks he's right: During much of the 1990's and the 2000's he, along with Geoff Hinton and Joshua Bengio, ignored negative criticism by many naysayers as the three of them persisted on researching deep neural networks, which a majority of AI researchers had dismissed as a dead-end. It wasn't until the late 2000's, when Hinton showed he could train restricted Boltzmann machines efficiently, that other AI researchers started paying closer attention. And of course everyone else piled on after 2012, when a deep neural network (AlexNet) won ImageNet by a wide margin over all other methods.
- dekhn 4y agoThe difference is that since Lecun made his contribution to MNIST, an entire field of endeavor with many experts as smart as him sprung into reality, and those people are making good criticism. You'd expect him to grow and mature (especially as the leader of an AI org at a major company) and learn to recognize that sometimes, he's really overhyping the technology more than necessary. I certainly got the same negative response when I worked in ML in the 90s- "computers aren't fast enough, we don't have enough data, and we don't have the algorithms" and to be honest, I didn't really have the capability to disprove the people saying that. So I appreciate that he persisted and was successful.
- cs702 4y ago> You'd expect him to grow and mature (especially as the leader of an AI org at a major company)... I agree. His behavior in this case cannot be justified.
- KKKKkkkk1 4y agoLook, if you don't like the work because the model is too big and expensive to run or because it is stochastic and can spit out garbage sometimes - that's valid criticism and something that a scientist can respond to. If you're going to level ideological accusations about biases and harms and the gender and race of the authors, then only people who share your ideology are going to be able to respond, and very few do.
- dang 4y agoMost of the OP is quotes from the article which discussed a few days ago here: Why Meta’s latest large language model survived only three days online - https://news.ycombinator.com/item?id=33670124 https://news.ycombinator.com/item?id=33670124 - Nov 2022 (119 comments)
- motohagiography 4y agoWhat this project created was something sophisticated and powerful, but not something people wanted, and they got (rightfully) pilloried for it. Instead of shaking ones fist at the world for rejecting your brilliance, maybe the really smart ones are making the things that others actually desire, and not merely developing techs that give themselves leverage over others and expecting the world to defer to this demonstration of intellectual prowess. This whole incident was a case study for product management and startup school 101. I've made this exact same category of error in developing products, where I said, "hey, look at this thing I built that may mean you don't have to do what you do anymore!" and then was surprised when people picked it apart for "dumb" reasons that ignored the elegance of having automated some problem away. If this model were really good, they would have used it to advance a bunch of new ideas in different disciplines before exposing it to the internet. Reality is, working at Meta/Facebook means they are too disconnected from the world they have influenced so heavily to be able to interpret real desire from people who live in it anymore. When you are making products to respond to data and no actual physical customer muse, you're pushing on a rope. I'd suggest the company has reached a stage of being post-product, where all that is left are "solutions," to the institutional customers who want some kind of leverage over their userbase, but no true source of human desire.
- jonstewart 4y agoIt’s a misplacement of priorities and misjudgment of character by ACM that they awarded the Turing prize to LeCun, yet haven’t bestowed it on Spaf. Deep Learning was promulgated by several computer scientists, and its still early days. Information security in academia? It’s Spaf. Perhaps it could be argued that his contributions don’t have the depth and rigor as LeCun’s research, but they’re broader, more sustained, and with patient good humor.
- poulpy123 4y agoWait I thought the AI that write scientific papers from a prompt was a joke. Did they really think they could do that ? Are they removed from reality?
- t3estabc 4y ago
- quantum_state 4y agoHope we all recognize that no matter how many parameters the current generation of ML models have, they are fundamentally a bunch of dump memories. Nothing new.