3 ms·
It's a good book, and one most programmers should read early on (it grows less useful over time), but to think of this as only an incremental improvement over m
by Jach 6y ago
It's a good book, and one most programmers should read early on (it grows less useful over time), but to think of this as only an incremental improvement over markov chains is underselling the advance. The technology is different, and can scale to much higher levels of capability. AGI levels? Almost certainly not. But it's passing usefulness thresholds so things can progress elsewhere.
- scottlocklin 6y ago>to think of this as only an incremental improvement over markov chains is underselling the advance. Erm, citations needed. It's a giant, inefficient and shitty KNN model, which is capable of mimicking markov chains. Wonderful marketing achievement and not much else.
- Jach 6y agohttps://www.gwern.net/GPT-3 https://www.gwern.net/GPT-3 (Edit: in case it's not clear, I suspect if you give an honest perusal of that page, and the pages it links, and the pages they link, you'll come away with a different opinion.)