4 ms·

LMM = Large Markov Model. I use that term because models like GPT-4 and friends are for all intents and purposes Markov chains with more data, more compute, som

LMM = Large Markov Model. I use that term because models like GPT-4 and friends are for all intents and purposes Markov chains with more data, more compute, some lossy compression, and a bit of nearest neighbor search. Next-word-engines. > why can't I say that your brain is nothing but a bunch of biological neurons trained using its input and intialized based on your genetics? Because we don't think one word at a time, and we don't restart from scratch for every subsequent word.

esafak 3y ago
GPT is not Markovian; it has state.
- hospitalhusband 3y ago
  Then it's a markov-like with state. Or as I've taken to calling them lately Markov+state. (I couldn't resist, sorry.) A truck towing a trailer isn't just a car because it pivots in the middle and has more wheels. It's fundamentals of operation are still closer to a car or truck without trailer than a bicycle. Humans can form thoughts and get to mostly correct answers even as a gut feeling, and the language to explain why/how need not even be present. We don't form thoughts one word at a time.
  - xcv123 3y ago
    No it is not Markov-like. GPT models are not Markov processes by definition. They take into account all previous words in the sequence when generating the next word. They have a type of memory in the form of an attention mechanism that refers to multiple previous states when generating tokens. They are not human-like and they are not Markov-like. GPT is a separate category.
sebzim4500 3y ago
>Because we don't think one word at a time In what sense does an LLM think one word at a time that doesn't also apply to a person typing at a keyboard? I'm typing one word at a time right now, I assume you aren't about to declare me a markov chain. When I read my brain presumably ingests one word at a time (not sure if it's one exactly, but it can't be much more than one). It is of course true that I have some notion of what I'm going to say before I right the first word, but seemingly so does an LLM. If it was truly thinking one word at a time, it wouldn't be able to consistently use 'an' vs 'a' correctly, for example. >we don't restart from scratch for every subsequent word. LLMs don't restart from scratch for every word, via the attention heads they can look back through the entire context. Otherwise the memory required for inference wouldn't scale with the context length.
- hospitalhusband 3y ago
  > In what sense does an LLM think one word at a time that doesn't also apply to a person typing at a keyboard? Because you already have the thought formed before you started typing. > When I read my brain presumably ingests one word at a time (not sure if it's one exactly, but it can't be much more than one) And these models ingest many vectors at once, up to the context length. Your brain is also recursive, and regularly goes backwards to rescan earlier words as necessary. Seems to me it's fundamentally inverted from how we operate, both input and output.
  - sebzim4500 3y ago
    >Because you already have the thought formed before you started typing. Can you prove that GPT-4 doesn't? Clearly there is a sense in which thinks more than one word ahead, since as I mentioned above it would not otherwise be able to use 'a' vs 'an' correctly. As far as I am aware, exactly to what extent these models have determined what tokens will be generated before they produce anything is an open question in mechanistic interpratability research. I would be very interested if you knew of some work that answers this question empirically.

esafak 3y ago

GPT is not Markovian; it has state.

hospitalhusband 3y ago
Then it's a markov-like with state. Or as I've taken to calling them lately Markov+state. (I couldn't resist, sorry.) A truck towing a trailer isn't just a car because it pivots in the middle and has more wheels. It's fundamentals of operation are still closer to a car or truck without trailer than a bicycle. Humans can form thoughts and get to mostly correct answers even as a gut feeling, and the language to explain why/how need not even be present. We don't form thoughts one word at a time.
- xcv123 3y ago
  No it is not Markov-like. GPT models are not Markov processes by definition. They take into account all previous words in the sequence when generating the next word. They have a type of memory in the form of an attention mechanism that refers to multiple previous states when generating tokens. They are not human-like and they are not Markov-like. GPT is a separate category.

sebzim4500 3y ago

>Because we don't think one word at a time In what sense does an LLM think one word at a time that doesn't also apply to a person typing at a keyboard? I'm typing one word at a time right now, I assume you aren't about to declare me a markov chain. When I read my brain presumably ingests one word at a time (not sure if it's one exactly, but it can't be much more than one). It is of course true that I have some notion of what I'm going to say before I right the first word, but seemingly so does an LLM. If it was truly thinking one word at a time, it wouldn't be able to consistently use 'an' vs 'a' correctly, for example. >we don't restart from scratch for every subsequent word. LLMs don't restart from scratch for every word, via the attention heads they can look back through the entire context. Otherwise the memory required for inference wouldn't scale with the context length.

hospitalhusband 3y ago
> In what sense does an LLM think one word at a time that doesn't also apply to a person typing at a keyboard? Because you already have the thought formed before you started typing. > When I read my brain presumably ingests one word at a time (not sure if it's one exactly, but it can't be much more than one) And these models ingest many vectors at once, up to the context length. Your brain is also recursive, and regularly goes backwards to rescan earlier words as necessary. Seems to me it's fundamentally inverted from how we operate, both input and output.
- sebzim4500 3y ago
  >Because you already have the thought formed before you started typing. Can you prove that GPT-4 doesn't? Clearly there is a sense in which thinks more than one word ahead, since as I mentioned above it would not otherwise be able to use 'a' vs 'an' correctly. As far as I am aware, exactly to what extent these models have determined what tokens will be generated before they produce anything is an open question in mechanistic interpratability research. I would be very interested if you knew of some work that answers this question empirically.