3 ms·

This seems more of a course about how to use Generative AI - does anyone have a good recommendation of a course or book about how they actually work?

mstibbard 3y ago
https://course.fast.ai https://course.fast.ai https://karpathy.ai/zero-to-hero.html https://karpathy.ai/zero-to-hero.html Both fantastic.
jmacd 3y ago
This Intro to Transformers is helpful to get some basic understanding of the underyling concepts and it comes with a really succint history lesson as well. https://www.youtube.com/watch?v=XfpMkf4rD6E https://www.youtube.com/watch?v=XfpMkf4rD6E
wsgeorge 3y ago
Kaparthy uploaded a 1hr talk to YouTube recently: https://www.youtube.com/watch?v=zjkBMFhNj_g https://www.youtube.com/watch?v=zjkBMFhNj_g
smokel 3y ago
It depends on your level of expertise. Andrew Ng's courses on Coursera are helpful to learn about the basics of deep learning. The "Generative AI for Everyone" course and other short courses offer some basic insight, and you can continue from there. https://www.coursera.org/specializations/deep-learning https://www.coursera.org/specializations/deep-learning https://www.deeplearning.ai/courses/generative-ai-for-everyone/ https://www.deeplearning.ai/courses/generative-ai-for-everyo... HuggingFace has some nice courses as well: https://huggingface.co/learn/nlp-course/ https://huggingface.co/learn/nlp-course/ Jay Allamer has a nice blog post on the Transformer architecture: https://www.deeplearning.ai/short-courses/ https://www.deeplearning.ai/short-courses/ And eventually you will probably end up reading papers on arxiv.org :)
eurekin 3y ago
I watched things mentioned in sibling comments, but didn't help. Until I found this: https://www.youtube.com/@algorithmicsimplicity https://www.youtube.com/@algorithmicsimplicity Instantly clicked. Both convolution and transformer networks. EDIT: for the purpose of visualization, I highly recommend following channel: https://www.youtube.com/watch?v=eMXuk97NeSI&t=207s https://www.youtube.com/watch?v=eMXuk97NeSI&t=207s It nicely explains and shows concepts of stride, features, window size, input to output size relation - in convolutional NN
- 3abiton 3y ago
  I would also recommend brilliant for absolute beginners, to get to interact with the material.
apwell23 3y ago
https://news.ycombinator.com/item?id=38331200 https://news.ycombinator.com/item?id=38331200
kragen 3y ago
thank you, the replies to your comment are far better than this marketroid rubbish that doesn't even tell you how to run a generative ai, much less write one
cl42 3y ago
Here's a list of free courses and textbooks: https://phaseai.com/resources/free-resources-ai-ml-2024 https://phaseai.com/resources/free-resources-ai-ml-2024 I reviewed all of these to ensure they're high quality + not sales/marketing fluff. Enjoy!

mstibbard 3y ago

https://course.fast.ai https://course.fast.ai https://karpathy.ai/zero-to-hero.html https://karpathy.ai/zero-to-hero.html Both fantastic.

jmacd 3y ago

This Intro to Transformers is helpful to get some basic understanding of the underyling concepts and it comes with a really succint history lesson as well. https://www.youtube.com/watch?v=XfpMkf4rD6E https://www.youtube.com/watch?v=XfpMkf4rD6E

wsgeorge 3y ago

Kaparthy uploaded a 1hr talk to YouTube recently: https://www.youtube.com/watch?v=zjkBMFhNj_g https://www.youtube.com/watch?v=zjkBMFhNj_g

smokel 3y ago

It depends on your level of expertise. Andrew Ng's courses on Coursera are helpful to learn about the basics of deep learning. The "Generative AI for Everyone" course and other short courses offer some basic insight, and you can continue from there. https://www.coursera.org/specializations/deep-learning https://www.coursera.org/specializations/deep-learning https://www.deeplearning.ai/courses/generative-ai-for-everyone/ https://www.deeplearning.ai/courses/generative-ai-for-everyo... HuggingFace has some nice courses as well: https://huggingface.co/learn/nlp-course/ https://huggingface.co/learn/nlp-course/ Jay Allamer has a nice blog post on the Transformer architecture: https://www.deeplearning.ai/short-courses/ https://www.deeplearning.ai/short-courses/ And eventually you will probably end up reading papers on arxiv.org :)

eurekin 3y ago

I watched things mentioned in sibling comments, but didn't help. Until I found this: https://www.youtube.com/@algorithmicsimplicity https://www.youtube.com/@algorithmicsimplicity Instantly clicked. Both convolution and transformer networks. EDIT: for the purpose of visualization, I highly recommend following channel: https://www.youtube.com/watch?v=eMXuk97NeSI&t=207s https://www.youtube.com/watch?v=eMXuk97NeSI&t=207s It nicely explains and shows concepts of stride, features, window size, input to output size relation - in convolutional NN

3abiton 3y ago
I would also recommend brilliant for absolute beginners, to get to interact with the material.

apwell23 3y ago

https://news.ycombinator.com/item?id=38331200 https://news.ycombinator.com/item?id=38331200

kragen 3y ago

thank you, the replies to your comment are far better than this marketroid rubbish that doesn't even tell you how to run a generative ai, much less write one

cl42 3y ago

Here's a list of free courses and textbooks: https://phaseai.com/resources/free-resources-ai-ml-2024 https://phaseai.com/resources/free-resources-ai-ml-2024 I reviewed all of these to ensure they're high quality + not sales/marketing fluff. Enjoy!