6 ms·

A spelled-out intro to neural networks and backpropagation [video]

154 points by hardmaru 4y ago

vintermann 4y ago
I'm sure Karpathy did a good job at Tesla to make self-driving cars - as good as anyone could have, anyway. But it's better for the world to have him back as a teacher/blogger/YouTuber/popularizer.
bekantan 4y ago
Can’t imagine the stress levels he had to endure at Tesla. Looking from the outside it seems totally worth it - he solved “the money problem” very young. Now he can do whatever the hell he wants and he keeps building because that’s what builders do. He’s such an inspiration.
motoboi 4y ago
I can't recommend enough this "backpropagation from scratch" from heremy howard (fastai) where he implementes backpropagation from scratch using python. UPDATE: link https://www.youtube.com/watch?v=CJKnDu2dxOE https://www.youtube.com/watch?v=CJKnDu2dxOE
- bilsbie 4y ago
  Do you have a link for that? My Lycos skills are failing me.
  - wil421 4y ago
    Try AltaVista.
    - xdavidliu 4y ago
      I'm more of an Infoseek user myself, though I've never bothered using AskJeeves.
  - deleted 4y ago
    [deleted]
  - Arrrlex 4y ago
    I believe GP is talking about part 2 of the fast.ai course: https://course19.fast.ai/videos/?lesson=8 https://course19.fast.ai/videos/?lesson=8
- notpublic 4y ago
  *Jeremy Howard
naillo 4y ago
Karpathy is awesome and I love that he's doing this and going down this route. (Hope he doesn't get that "offer he can't refuse" like carmack predicted and keeps doing educational stuff for us all :).)
voydik 4y ago
Andrej, this is really good. I like how you clearly and succinctly describe how it works. I subscribed to your channel! Thanks for sharing.
oxplot 4y ago
Wow — this was in fact the most easy to understand and yet from-first-principles intro to NN that I've seen. Glad Andrej is focusing on ML education.
fezfight 4y ago
The poster of this link, hardmaru, is no slouch either. Their work with evolutionary strategies is eye opening. otoro.net/ml or their twitter account @hardmaru if you want to see for yourself. Thanks for the link hardmaru!
sva_ 4y ago
This is a very nice video from what I've seen so far. Hoping to see more from Karpathy. He seems to have a talent in explaining things.

154 points by hardmaru 4y ago

I'm sure Karpathy did a good job at Tesla to make self-driving cars - as good as anyone could have, anyway. But it's better for the world to have him back as a teacher/blogger/YouTuber/popularizer.

bekantan 4y ago

Can’t imagine the stress levels he had to endure at Tesla. Looking from the outside it seems totally worth it - he solved “the money problem” very young. Now he can do whatever the hell he wants and he keeps building because that’s what builders do. He’s such an inspiration.

motoboi 4y ago

I can't recommend enough this "backpropagation from scratch" from heremy howard (fastai) where he implementes backpropagation from scratch using python. UPDATE: link https://www.youtube.com/watch?v=CJKnDu2dxOE https://www.youtube.com/watch?v=CJKnDu2dxOE

bilsbie 4y ago
Do you have a link for that? My Lycos skills are failing me.
- wil421 4y ago
  Try AltaVista.
  - xdavidliu 4y ago
    I'm more of an Infoseek user myself, though I've never bothered using AskJeeves.
- deleted 4y ago
  [deleted]
- Arrrlex 4y ago
  I believe GP is talking about part 2 of the fast.ai course: https://course19.fast.ai/videos/?lesson=8 https://course19.fast.ai/videos/?lesson=8
notpublic 4y ago
*Jeremy Howard

naillo 4y ago

Karpathy is awesome and I love that he's doing this and going down this route. (Hope he doesn't get that "offer he can't refuse" like carmack predicted and keeps doing educational stuff for us all :).)

voydik 4y ago

Andrej, this is really good. I like how you clearly and succinctly describe how it works. I subscribed to your channel! Thanks for sharing.

oxplot 4y ago

Wow — this was in fact the most easy to understand and yet from-first-principles intro to NN that I've seen. Glad Andrej is focusing on ML education.

fezfight 4y ago

The poster of this link, hardmaru, is no slouch either. Their work with evolutionary strategies is eye opening. otoro.net/ml or their twitter account @hardmaru if you want to see for yourself. Thanks for the link hardmaru!

sva_ 4y ago

This is a very nice video from what I've seen so far. Hoping to see more from Karpathy. He seems to have a talent in explaining things.