4 ms·
Didn't you just described an nth-order Hidden Markov Chain ?
by JPLeRouzic 3y ago
Didn't you just described an nth-order Hidden Markov Chain ?
- dragonwriter 3y ago> Doesn’t you just described an nth-order Hidden Markov Chain ? Yes, and its not exactly strictly accurate (at least on a more useful level than a description which simplifies to a Turing machine would be, which would be technically accurate, too) as to exactly how models work, which is why I said “(simplified)”, but it is, I think, accurate enough for the question asked. The AI “magic”, such as it is, is in the shape of the function that “decides” what output to produce for a given input, not in deciding to produce output at all.
- JPLeRouzic 3y agoThanks, Is there a toy conversational LLM on Github or elsewhere? Something like: https://github.com/karpathy/nanoGPT https://github.com/karpathy/nanoGPT