3 ms·
You can disagree with his conclusions but I don't think his understanding of small models is up for debate. This is the person who created micrograd/makemore/na
by mprovost 1y ago
You can disagree with his conclusions but I don't think his understanding of small models is up for debate. This is the person who created micrograd/makemore/nanoGPT and who has produced a ton of educational materials showing how to build small and local models.
- khalic 1y agoI’m going to edit, it was badly formulated, he underestimates their potential for growth is what I meant by that
- diggan 1y ago> underestimates their potential for growth As far as I understood the talk and the analogies, he's saying that local models will eventually replace the current popular "mainframe" architecture. How is that underestimating them?