4 ms·
Yes but in the same way as saying that computers are just a Markov chain.
by karpathy 4y ago
Yes but in the same way as saying that computers are just a Markov chain.
- nurettin 4y agoAfter all the epic content and research, I think this was your worst explanation ever.
- karpathy 4y ago:(
- HopenHeyHi 4y ago[flagged]
- ShamelessC 4y ago[flagged]
- yinser 4y agoPay no mind to him I think it’s brilliant. There, canceled out :) Many of us look to you as the GOAT of teaching
- nurettin 4y agoSorry, I just didn't like the comparison between saying GPT is a markov chain and computers are a markov chain. Really learned something from the actual colab. Thank you, appreciated. Nobody likes a sad karpathy.
- whiplash451 4y agoUnfair and irrelevant. Keep it up, Andrej!
- ImprobableTruth 4y agoComputers are (with a couple caveats) deterministic, so I think the better analogy would be to say that it's the same as saying that "computers are just state machines". But this is a bit nitpicky. The core idea is of course conveyed either way, that yes, this very abstract model does describe it while also completely missing that the magic is in how it's done.
- gary_0 4y agoIf I can continue the nitpickery, plenty of computer algorithms are deterministic but also pseudorandom--including Markov chains. Only when the randomness is outside your control are things truly non-deterministic. A simulation with many possible outcomes is still deterministic if you get to choose the "seed". In other words, statistical permutations are deterministic if you control all the input variables (in terms of computer science; physics is another story).
- dr_kiszonka 4y agoComputers have memory! Oh, wait... so does ChatGPT. Or am I forgetting something...