3 ms·

Which resources from these two would you recommend? Or just blanket-recommend all their videos/books?

len_testa 1mo ago
I've read Raschka's "Build Your Own LLM from Scratch" book and really enjoyed it. I haven't tried the code yet, but the code from his previous Python ML book worked great.
fancyfredbot 1mo ago
I kind of want to blanket recommend but that's not very helpful I would suggest starting with Andrej Karpathy's YouTube video: https://youtu.be/kCc8FmEb1nY?is=oiDsrBYJg_MUUmoD https://youtu.be/kCc8FmEb1nY?is=oiDsrBYJg_MUUmoD This video is excellent. I'm a huge fan. Also the video is zero commitment and instantly available which makes it a good way to check you are interested. The book by Sebastian Raschka is slightly less accessible but very reasonably priced and the experience of working through a book is a lot nicer than skipping back and forth in a video (for me). Sebastian's blog posts on recent architectures are absolutely great too.
- mettamage 1mo ago
  Thanks! Will definitely look into it. I'm currently grinding Math Academy to fix my math deficiencies so I can understand LLMs.
dominotw 1mo ago
actually just use chatgpt. There is a new mode of learning thats now avaiable that doesnt require you to read about things that are already discovered leaving you with a shallow knowledge. you can now play the inventor and start with question "i want to build next token prediction software" and go as far as you can with your current knowledge while brainstroming with chatgpt as a rubber duck. dont not start with a course on probabality , linear algebra or calculus . do not watch 3 hr videos or 3blue animations . there is agood video on this way to learn. https://www.youtube.com/watch?v=cbiyPOn-__M&t=380s https://www.youtube.com/watch?v=cbiyPOn-__M&t=380s
- janalsncm 1mo ago
  I think ChatGPT is a great way to get depth on a topic. You can Q&A for a while until you get it, and it won’t get impatient with you. That said, I think traditional resources are a better way to get breadth and to frame the topic. Just chatting about something can be a little disorienting imo.
  - dominotw 1mo ago
    i think process of discovering what to study is as important as stuyding something. thats the main problem with traditoinal format.

I've read Raschka's "Build Your Own LLM from Scratch" book and really enjoyed it. I haven't tried the code yet, but the code from his previous Python ML book worked great.

fancyfredbot 1mo ago

I kind of want to blanket recommend but that's not very helpful I would suggest starting with Andrej Karpathy's YouTube video: https://youtu.be/kCc8FmEb1nY?is=oiDsrBYJg_MUUmoD https://youtu.be/kCc8FmEb1nY?is=oiDsrBYJg_MUUmoD This video is excellent. I'm a huge fan. Also the video is zero commitment and instantly available which makes it a good way to check you are interested. The book by Sebastian Raschka is slightly less accessible but very reasonably priced and the experience of working through a book is a lot nicer than skipping back and forth in a video (for me). Sebastian's blog posts on recent architectures are absolutely great too.

mettamage 1mo ago
Thanks! Will definitely look into it. I'm currently grinding Math Academy to fix my math deficiencies so I can understand LLMs.

dominotw 1mo ago

actually just use chatgpt. There is a new mode of learning thats now avaiable that doesnt require you to read about things that are already discovered leaving you with a shallow knowledge. you can now play the inventor and start with question "i want to build next token prediction software" and go as far as you can with your current knowledge while brainstroming with chatgpt as a rubber duck. dont not start with a course on probabality , linear algebra or calculus . do not watch 3 hr videos or 3blue animations . there is agood video on this way to learn. https://www.youtube.com/watch?v=cbiyPOn-__M&t=380s https://www.youtube.com/watch?v=cbiyPOn-__M&t=380s

janalsncm 1mo ago
I think ChatGPT is a great way to get depth on a topic. You can Q&A for a while until you get it, and it won’t get impatient with you. That said, I think traditional resources are a better way to get breadth and to frame the topic. Just chatting about something can be a little disorienting imo.
- dominotw 1mo ago
  i think process of discovering what to study is as important as stuyding something. thats the main problem with traditoinal format.