4 ms·
LLM are not fancy Markov chains. These are more than mere statistical prediction. They contain large deeply layered attentional networks which are perfectly cap
by adastra22 4y ago
LLM are not fancy Markov chains. These are more than mere statistical prediction. They contain large deeply layered attentional networks which are perfectly capable of representing complex, arbitrarily structured models, trained from the data set or assembled on the fly based on input. I'm sorry, but I think you are about a decade or so out of date in your intuitions for how these things work. (And a decade is a long time in this field.)
- JohnFen 4y agoI will grant that my understanding is not complete (and would argue that pretty much everyone else's is incomplete as well), but it's not out of date. I have deliberately avoided forming any opinion about this stuff until I learned more about what the modern approach is. I'm not relying on what I learned a decade ago.