4 ms·
Ask HN: Textbook Regarding LLMs
Are there any textbooks that cover LLMs in depth? I’m looking to read papers (especially review articles) or a textbook instead of trying to piece everything together from papers or blogs or watching YouTube videos, despite there obviously being some good stuff out there.
- mindcrime 3y agoI haven't seen any yet. Closest thing to that that I've seen would be something like one of these: https://www.amazon.com/Transformers-Natural-Language-Processing-Computer/dp/1805128728 https://www.amazon.com/Transformers-Natural-Language-Process... https://www.amazon.com/Natural-Language-Processing-Transformers-Revised/dp/1098136799/ https://www.amazon.com/Natural-Language-Processing-Transform... https://www.amazon.com/Generative-Deep-Learning-Teaching-Machines/dp/1098134184 https://www.amazon.com/Generative-Deep-Learning-Teaching-Mac... I wish I could give you a detailed review of all of those, but sadly while I have all three, I've been too slammed with other stuff to make much progress on any of them. :-( And while it's not a book, there's that video series by Andrej Karpathy: https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs...
- kadushka 3y agoI've read the second book (by Tunstall et al). It's excellent.
- nborwankar 3y agoSee Large Language Models - a Survey. Minaee et al https://arxiv.org/abs/2402.06196 https://arxiv.org/abs/2402.06196
- p1esk 3y agoThanks! Big names among authors, I’m going to read it.
- nborwankar 3y agoHere’s another one - it’s older but has some interesting charts and graphs. https://arxiv.org/abs/2303.18223 https://arxiv.org/abs/2303.18223
- sandwichukulele 3y agosomeone here is writing such a book in public, here's the thread with the discussion "Implementing a ChatGPT-like LLM from scratch, step by step" https://news.ycombinator.com/item?id=39156778 https://news.ycombinator.com/item?id=39156778 you can view the github for the book as they work on it https://github.com/rasbt/LLMs-from-scratch https://github.com/rasbt/LLMs-from-scratch
- TowerTall 3y agoI have pre-ordered this book: Build a Large Language Model (From Scratch) https://www.manning.com/books/build-a-large-language-model-from-scratch https://www.manning.com/books/build-a-large-language-model-f...