3 ms·
Karpathy discusses viewing GPT as a finite-state Markov chain in this Twitter thread (and especially in the intro to the linked Colab notebook) : https://twitte
by psyklic 3y ago
Karpathy discusses viewing GPT as a finite-state Markov chain in this Twitter thread (and especially in the intro to the linked Colab notebook) : https://twitter.com/karpathy/status/1645115622517542913 https://twitter.com/karpathy/status/1645115622517542913
- ftxbro 3y agoThe comment I had in mind was when he said "Yes but in the same way as saying that computers are just a Markov chain." in response to "Is GPT simply a Markov chain?" https://news.ycombinator.com/item?id=35506756 https://news.ycombinator.com/item?id=35506756