4 ms·
“It’s a stochastic” doesn’t flow, though I guess I could use "stochastic random walk." What properties does a gpt-3 model have that a Markov chain doesn’t? (Ot
by sillysaurusx 5y ago
“It’s a stochastic” doesn’t flow, though I guess I could use "stochastic random walk."
What properties does a gpt-3 model have that a Markov chain doesn’t? (Other than effectiveness.)
- exdsq 5y agoANNs aren't Markov chains
- sillysaurusx 5y agoWell, yes. And apples aren't oranges, but they share a lot of similar traits. "Given a prompt, provide a completion" is what a Markov chain does. GPT-3 is exactly the same, in the sense that apples and oranges both satisfy your hunger.
- tomrod 5y agoIs calculator.exe the equivalent to TI-84?
- sillysaurusx 5y agoI would say that a TI-84 is a glorified calculator.exe. The TI-84 is usually more effective, but they’re both calculators.
- toxik 5y agoWillfully misunderstanding your interlocutor seems ungracious, you apparently know stochastic is an adjective, so why did you try to use it as a noun? GPT-3 is conditioned on the entire input sequence as well as its own output, which is strictly NON-MARKOVIAN. In fact, the point in saying something is Markovian is exactly that: the state transition probability only depends on the current state.
- immibis 5y agoBut the current state could include all of the last N output tokens.