4 ms·
Thank you for answering a question I had half formed in my head. Do LLMs have logical rules built in? What makes them different to a very advanced Markov chain
by bloopernova 3y ago
Thank you for answering a question I had half formed in my head.
Do LLMs have logical rules built in? What makes them different to a very advanced Markov chain?
Are there any models out there that start from logical principles and train on top of that?
(Apologies for poor understanding of the field)
- ajross 3y ago> What makes them different to a very advanced Markov chain? Really nothing. There's some feedback structure in the layers of the model, it's not just one big probability table. But the technique is fundamentally the same, it's Markov, just with the whole conversation as input and with billions of parameters.
- famouswaffles 3y ago>Do LLMs have logical rules built in? Handcrafted by humans ? No But it's still possible to learn such rules from the data in an effort to complete the primary objective (predicting the next token)
- justanotherjoe 3y agoThere's no logical rules built in at all. But Transofmers architecture is specifically trained to learn combinatoric play and rules of engagement from the data, so it can extrapolate and do cool, new things, that are not in the training data. In a way, you give them a chess board, the rules of the game, and then it can play. You don't teach them every possible board state. What's interesting is with significant amount of parameters it seems to encode more and more abstract and human-like understanding of the 'elements' at play and the 'rules of engagement' on top of them. Edit: Not native. I'm not sure 'rules of engagement' is the correct english term here.
- bloopernova 3y agoI understood you just fine, your English is great! Thank you for the explanation. It seems like the LLM "plays" to learn? That's very cool, thank you again.