4 ms·
> since you'll be creating everything from scratch (i.e. from only Python and its standard library) Is this correct? I skimmed the notes for both parts 1 & 2 a
by detrites 4y ago
> since you'll be creating everything from scratch (i.e. from only Python and its standard library)
Is this correct? I skimmed the notes for both parts 1 & 2 and they stated requiring PyTorch?
- jph00 4y agoYes, after we create something from scratch, we then see how to use implementations from libraries such as PyTorch. For basic operations like convolution, whilst we do create a GPU-accelerated version, it's not as fast as PyTorch/cudnn's highly-optimised version, so we use the PyTorch implementation for the rest of the course, rather than our handmade version. So that means that nothing is mysterious, since we know how it's all made, but we also see where and how to use existing libraries as appropriate. In practice, during the course we end up using PyTorch for stuff like gradients, matrix multiplication, and convolutions, and our own implementations for a lot of the stuff that's at a higher level than that (e.g. we use our own ResNet, U-net, etc.)
- detrites 4y agoAmazing, that's exactly what I've been looking for and what I'm sure many here will appreciate. Thank you!
- psychoslave 4y agoWow, you are really fulfilling the promise of a pragmatic approach. Awesome!
- matsemann 4y agoAh, I've been waiting for this, looking forward to going through it! While I appreciate your top-down approach and buy your arguments for doing it this way in previous courses, I also like this new bottom-up where one really learns what lies beneath.
- noob_eng 4y agoSomething of this sort is also done by Andrej Karpathy in his Zero to Hero Series:https://karpathy.ai/zero-to-hero.html https://karpathy.ai/zero-to-hero.html