4 ms·
Markov chains look like absolute gibberish almost all the time whereas GPT-2/3 (especially 3) generate natural sounding sentences. If you think they’re equivale
by colejohnson66 4y ago
Markov chains look like absolute gibberish almost all the time whereas GPT-2/3 (especially 3) generate natural sounding sentences. If you think they’re equivalent in capability, you haven’t spend any time using GPT-3.
- trasz 4y agoThey are more naturally sounding, sure, but semantically it’s the same - there are no signs of any intelligent thought there, it’s all gibberish that just happens to match patterns it was trained against. You could imagine a bot which takes your question, googles it, and then assembles the answer based on random pieces from millions of search results that happen to match the syntactical structure of the sentence - and you wouldn’t really be that far off.
- thatjoeoverthr 4y agoSo make the bot. I paste in SAT reading comprehension questions including whole short stories and GPT3 gets them right. It’s not gibberish. It’s not even just cogent. Go throw your bot together and Show HN. I’ll wait.
- trasz 4y ago>I paste in SAT reading comprehension questions including whole short stories and GPT3 gets them right. It’s not gibberish. Can you show me? As in, paste the question here?
- mr_toad 4y ago> there are no signs of any intelligent thought there, it’s all gibberish that just happens to match patterns it was trained against I meet people that regurgitate what they’ve heard on Facebook all the time, are you suggesting there is no intelligent thought there either?
- mort96 4y agoAre you implying that those people literally never do anything other than regurgitate stuff from Facebook? Because yeah, such a person could probably be described as not having intelligence, but I also have never met or heard of such a person.