6 ms·
This may be true in other cases, but not here. Hinton literally wrote the paper on backpropagation, the way that modern neural networks are trained. He won the
by jxmorris12 3y ago
This may be true in other cases, but not here. Hinton literally wrote the paper on backpropagation, the way that modern neural networks are trained. He won the Turing award for a reason.
- UncleMeat 3y agoHinton was critical for the development of ai. But was he critical for the development of openai, the company? Loads of startups get eminent people on their boards largely for advertising.
- Fricken 3y agoHinton's protege Ilya Sutskever has been critical to Open AI's success.
- jstx1 3y agoHas he contributed that much personally? I thought a lot of the success of ChatGPT is some good ideas from lower ranked researchers + great engineering.
- parthdesai 3y agoHe is the co-founder and chief scientist[0] at OpenAI but "has he contributed that much personally". I don't even know how to respond to that [0]https://www.linkedin.com/in/ilya-sutskever/ https://www.linkedin.com/in/ilya-sutskever/
- jstx1 3y agoI asked the question knowing that he's a co-founder and chief scientist at OpenAI. Being in his position doesn't automatically mean that he's contributed meaningfully.
- shadowgovt 3y agoIt's a bit in the category of "When you consider all factors, how important was Isaac Newton's work to Einstein's discoveries?"
- thomasahle 3y agoMy experience in "Applied Research" is that often "good ideas from lower ranked researchers" (or good ideas from anyone really) is "I saw this cool paper, let's try and implement that". That doesn't mean top people like Hinton should get all the credit, but let's not kid ourselves and believe most of the ideas didn't origin in academia. One of GOpenAI's recent breakthroughs was switching to FlashAttention, invented at Stanford and University at Buffalo.
- lostmsu 3y agoIsn't Hinton's paper on backprop just a "let's try to implement that" for a multilayer network?
- thomasahle 3y agoI'm not going to claim Hinton "invented backprop". He even says he didn't himself: https://www.reddit.com/r/MachineLearning/comments/g5ali0/comment/fo8rew9/ https://www.reddit.com/r/MachineLearning/comments/g5ali0/com...
- d23 3y agoWhat does it matter? How is it relevant to the article or his reason for leaving Google?
- byyy 3y agoA lot of the developments of AI in different companies Hinton was not directly responsible for. Hinton never had anything to say about those companies, I don't think he's vying for limelight. The fact that he never said anything before and the fact that he's saying something now means two things in my mind: 1. He is noticing something different about the current iteration of AI technology. We crossed some threshold. 2. Hinton is being honest.
- aardvarkr 3y agoThanks for adding context