4 ms·
Do "current gen" llms use Markov Chains? I have been wanting to look into trying to understand this stuff but I honestly don't know where to begin. I guess I
by imetatroll 3y ago
Do "current gen" llms use Markov Chains? I have been wanting to look into trying to understand this stuff but I honestly don't know where to begin.
I guess I should clarify that I prefer being able to purchase textbooks or use free online sources.
- larodi 3y agoThere are many attempts at using attention-less approaches to the architecture, and Markov Chains being one of them. Nothing to compete with transformers yet though, AFAIK. Some people experiment with graph-based rules systems, like very smartly compressed grammars (otherwise the task is NP-Hard i think).