6 ms·
I'm not really sure I understand the hype anyway. All GPT-3 does is generate text from human input to begin with, it's not actually at all intelligent as the pe
by Barrin92 6y ago
I'm not really sure I understand the hype anyway. All GPT-3 does is generate text from human input to begin with, it's not actually at all intelligent as the person from the Turing test thread pointed out.
Sure GPT-3 can respond with factoids, but it doesn't actually understand anything. If I have a chat with the model and I ask it "what did we talk about thirty minutes ago" it's as clueless as anything. A few weeks ago computerphile put out a video of GPT-3 doing poetry that was allegedly only identified as computer generated half of the time, but if you actually read the poems they're just lyrically sounding word salad, as it does not at all understand what it's talking about.
Honestly the only expectations I have for this is generating a barrage of spam or fake news that uncritical readers can't distinguish from human output.
- woko 6y ago> generating a barrage of spam or fake news that uncritical readers can't distinguish from human output. Which could indirectly bring good things: what if this decreases our tolerance threshold for nonsensical texts? For instance, people might become more impatient when faced with click-bait articles, because they know they might have been written by an AI in order to waste their time. This would let people skip the articles after the first sentence without feeling any guilt or doubt about it. At least, I hope it might open the eyes of uncritical readers.
- ricksharp 6y agoClickbait articles have been generated by AI for many years, yet they still exist. In fact, clickbait is a global GAN monetized by Ad revenue. (In this case the adversary is humans who decide whether or not a specific title is worth a click.)
- dnautics 6y agoNone of minimaxirs queries directly test creativity with open ended responses, for example: "name a bird that starts with the same letter as the color that's a fruit"
- jpindar 6y agoThe value of a Turing test is highly dependent on the quality of the judge (or how hard they are trying).
- nullc 6y agoLetter questions are atypically hard for GPT2/3, FWIW. The input is dictionary compressed data and it only learns stuff about letters indirectly. As a result GPT2 is hopeless: it does however correctly answer color that's a fruit-- an answer which wasn't obvious to me. But you can't generally get it to operate on first letters. GPT3 has shown some capability to operate on first letters, but it's less good than it is at other things. GPT2/3 also have fixed depth computation, so compound requests can be hard for it (though GPT3 seems a lot better)
- jcims 6y agoI would honestly just suggest you spend some time interacting with it when you get a chance. Yes it still spews nonsense and no there isn't understanding, but it is qualitatively better than GPT-2 and has somewhat remarkable range. The hype is more about the potential rather than the capability.
- FeepingCreature 6y agoThere is genuine understanding! What there isn't is wide-range coherence, which is not the same thing. The system can clearly generalize patterns, it just has no reliable concept of sticking to them.
- ricksharp 6y agoThe flood unleashed may drive humanity to return to one-one communication (face to face) as the only form of authentic communication.
- nullc 6y ago> If I have a chat with the model and I ask it "what did we talk about thirty minutes ago" it's as clueless as anything. Come on, this is from a specific structural limit. The transformer only looks back a thousand symbols or so. If you simply scaled it up it would handle that fine. (it's costly to scale up this architecture). > but if you actually read the poems they're just lyrically sounding word salad, This is what a lot of famous poetry sounds like to some people. Saying it doesn't "understand" really sounds like a lot of what people said about chess engines in the early 90s. However you define understanding, if it doesn't have it probably doesn't need it to still do amazing and useful things. The new Navy Seal copypasta GPT3 wrote on gwerns blog is the greatest of that form I've ever seen by a wide margin. It is witty, clever, and hilarious. Could a very talented writer do as well? Probably. But none would ever bother ... because it's just a silly joke yet gpt3 generates world class raging navy seal 24/7 rain or shine on demand. https://www.gwern.net/GPT-3#navy-seal-copypasta https://www.gwern.net/GPT-3#navy-seal-copypasta (best screamed) People seem unbounded in their ability to hype this stuff. Sure, it has significant limitations. But so what? Decades ago someone might have asked "What use is a 'computer' if it cannot learn to love?" --- yet we can all agree computers have been extremely useful. If GPT's output brings beauty or truth to you does it matter that the computer lacks some vague property humans have? People can find meaning in waterfalls and sunsets, knowledge from looking at the stars. If we learn or feel something on an account of a great machine that read the whole internet that would seem to me to be the least surprising of all these examples.
- Barrin92 6y agoPeople can find meaning in everything, that doesn't make waterfalls or sunsets intelligent, it makes people intelligent. The reason why the transformer can only look back a thousand symbols is because it doesn't have an actual high human-level narrative structure of a conversation or any idea of persistent entities in the way we do. If I have a conversation with you I can remember the content because I have an idea of "you" and "I" and of persistent entities in the world, and of a whole ontology that makes me able to make sense of the world, not some sort of transformer soup of a hundred billion parameters. The same is true for the poetry, it doesn't matter whether people can't tell the difference, but a human poet expresses intent and meaning through poetry, poets don't statistically cue words together without underlying meaning. The Navy Seal copy pasta is funny to you, because you know what a Navy Seal is. The model merely has strung syntax together.
- davesque 6y ago> If I have a chat with the model and I ask it "what did we talk about thirty minutes ago" it's as clueless as anything. I don't really know about the functional limitations of GPT-3's web API but, assuming there are none related to what I'm about to suggest, you could potentially overcome this problem by representing the "state" of an overall conversation literally in the prompt. For example, begin with, "Me: Hello, sir! How are you? Computer: " as a prompt. Receive a response from GPT-3 like, "Me: Hello, sir! How are you? Computer: I'm fine, how are you? ... <other less relevant generated text>" Clip of the less relevant part, add your next communication, then feed the entire dialogue back to GPT-3 as a second prompt and see if it decides to continue the dialogue.
- sama 6y ago"Understand" is up for debate, but it's clearly learning something. The fact that it's possible to learn general structure as well as we can from unlabeled data does seem like a significant development.
- jpttsn 6y agoComputers can now produce text that is indistinguishable from (badly) human-produced text. Arguably they always could; it’s less bad now than ever. The “Turing test”/Chinese Room school of thought would assume that as the text becomes better, it is at some point good evidence of reasoning behind the scenes. I never bought that: there should be “easier” ways (than reasoning) if you just want to produce human-level text output.