3 ms·
The problem with this simplification is a bog standard Markov chain fits the description as well, but quality of predictions is rather different. Yes the LLM d
by baq 4y ago
The problem with this simplification is a bog standard Markov chain fits the description as well, but quality of predictions is rather different.
Yes the LLM does generate text. No it doesn’t ‘just generate text that’s it’.
- peterashford 4y ago"It generates text better than a Markov chain" - problem solved
- baq 4y agoClassic goal post moving.
- peterashford 4y agoNot really, I think the original post was just being a post, not a scientific paper. Sometimes people speak normally
- Izkata 4y agoThe biggest problem I've seen when people try to explain it is in the other direction, not people describing something generic that can be interpreted as a Markov chain, they're actually describing a Markov chain without realizing it. Literally "it predicts word-by-word using the most likely next word".