3 ms·
> It takes years to become competent at the math needed for AI (Assuming that "AI" refers to large language models) The best open source LLM fits in less than
by johndough 2y ago
> It takes years to become competent at the math needed for AI
(Assuming that "AI" refers to large language models)
The best open source LLM fits in less than 300 lines of code and consists mostly of matrix multiplications. https://github.com/meta-llama/llama3/blob/main/llama/model.py https://github.com/meta-llama/llama3/blob/main/llama/model.p...
Anyone with a basic grasp of linear algebra can probably learn to understand it in a week. Here is a video playlist by former Stanford professor and OpenAI employee Andrej Karpathy which should cover most of it (less than 16 hours total): https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxb...