4 ms·
Has he contributed that much personally? I thought a lot of the success of ChatGPT is some good ideas from lower ranked researchers + great engineering.
by jstx1 3y ago
Has he contributed that much personally? I thought a lot of the success of ChatGPT is some good ideas from lower ranked researchers + great engineering.
- parthdesai 3y agoHe is the co-founder and chief scientist[0] at OpenAI but "has he contributed that much personally". I don't even know how to respond to that [0]https://www.linkedin.com/in/ilya-sutskever/ https://www.linkedin.com/in/ilya-sutskever/
- jstx1 3y agoI asked the question knowing that he's a co-founder and chief scientist at OpenAI. Being in his position doesn't automatically mean that he's contributed meaningfully.
- shadowgovt 3y agoIt's a bit in the category of "When you consider all factors, how important was Isaac Newton's work to Einstein's discoveries?"
- thomasahle 3y agoMy experience in "Applied Research" is that often "good ideas from lower ranked researchers" (or good ideas from anyone really) is "I saw this cool paper, let's try and implement that". That doesn't mean top people like Hinton should get all the credit, but let's not kid ourselves and believe most of the ideas didn't origin in academia. One of GOpenAI's recent breakthroughs was switching to FlashAttention, invented at Stanford and University at Buffalo.
- lostmsu 3y agoIsn't Hinton's paper on backprop just a "let's try to implement that" for a multilayer network?
- thomasahle 3y agoI'm not going to claim Hinton "invented backprop". He even says he didn't himself: https://www.reddit.com/r/MachineLearning/comments/g5ali0/comment/fo8rew9/ https://www.reddit.com/r/MachineLearning/comments/g5ali0/com...