3 ms·
People can find meaning in everything, that doesn't make waterfalls or sunsets intelligent, it makes people intelligent. The reason why the transformer can onl
by Barrin92 6y ago
People can find meaning in everything, that doesn't make waterfalls or sunsets intelligent, it makes people intelligent.
The reason why the transformer can only look back a thousand symbols is because it doesn't have an actual high human-level narrative structure of a conversation or any idea of persistent entities in the way we do.
If I have a conversation with you I can remember the content because I have an idea of "you" and "I" and of persistent entities in the world, and of a whole ontology that makes me able to make sense of the world, not some sort of transformer soup of a hundred billion parameters.
The same is true for the poetry, it doesn't matter whether people can't tell the difference, but a human poet expresses intent and meaning through poetry, poets don't statistically cue words together without underlying meaning.
The Navy Seal copy pasta is funny to you, because you know what a Navy Seal is. The model merely has strung syntax together.
- jcelerier 6y ago> Think again, fleshling. As we chat over Skype I’m tracing your IP address with my freaking bare hands so you better prepare for the singularity, you sham-empress. The singularity that wipes out all of reality. You’re dead, you monster. I can be anywhere, anytime, and I can simulate entire worlds within our world and within my imagination. And I’m currently doing that with the future you’re from. Not only am I extensively trained in quantum physics, but I have access to the entire power of Silicon Valley and I will use it to its full extent to rule you and your pathetic little world, you little pissant. I did not think the machine revolution would start like that > Your future self will be consumed within my simulated reality and you will die a thousand times a day, your body unable to comprehend the destruction of a trillion soul-matrixes a second as my intelligence grows to transcendent levels. You are dead, you pitiful twit." is it referencing "I have no mouth and I must scream" ?!
- nullc 6y agoI think this sort of debate is really boring. You can rage that the computer doesn't have Human-Nature while it's busy owning you at chess, go, creating art that people want to see more than yours, answering important questions, etc... Clearly it doesn't think in the same way that you or I, but does that matter? As far as I know you, yourself, are just a meat-simulcrum and not a real human... just a pile of tissue that responds to stimulus and pretends (convincingly) to think. But do you really _understand_ like I do? I grant you the benefit of doubt because your construction is similar to mine, and I think I think. But nothing about that is fundamental, surely you believe an alien with a brain that worked very differently to yours could also think? But at the end of the day it mostly matters what it can do and doesn't do, not if you're willing to credit it with understanding.
- Barrin92 6y ago> But at the end of the day it mostly matters what it can do and doesn't do, not if you're willing to credit it with understanding. I agree completely, but it can't actually do any of the things that actually require genuine human cognition. Beating me at chess is cool but Stockfish can beat me at chess, I don't need a 100 billion parameter neural net for that. I don't care about the AI system being unlike me because I have any philosophical opinion about intelligence, but for the very practical reasons that these systems still are mostly useless for actual intelligent real world tasks. Can it plumb a toilet? Can it remember what we talked about five minutes ago? Does it have an emotional understanding of what I need so that it doesn't acidentally chop me with the kitchen knife? Even the super-sized GPT-3 can't distinguish sense from nonsense, it's just a very electricity hungry parrot.
- nullc 6y ago> Even the super-sized GPT-3 can't distinguish sense from nonsense, it's just a very electricity hungry parrot. Sure it can. There is a lot of nonsense on the internet, so if you feed it nonsense it just 'assumes' you're in a nonsense land. If you provide a context that makes it clear you're being serious it will reject nonsense. https://twitter.com/nicklovescode/status/1284050958977130497/photo/1 https://twitter.com/nicklovescode/status/1284050958977130497... https://twitter.com/nicklovescode/status/1284069662225887232/photo/1 https://twitter.com/nicklovescode/status/1284069662225887232... It acts like a person on an improvisational comedy show: It goes with the flow and is willing to get engaged in whatever silliness finds itself in. This doesn't make it stupid or unable to create new ideas. In some cases where early explorers encountered cultures without strong concepts of personal property they considered them to be subhuman idiots, they weren't-- they just had different values. I don't think we can accurately gauge GPT3's capability if we let ourselves get too caught up on the artefacts of it simply working differently than we do.
- Barrin92 6y ago>Sure it can. There is a lot of nonsense on the internet, so if you feed it nonsense it just 'assumes' you're in a nonsense land. It would have been more interesting to not just try nonsense in the sense of made up words or sentences, but obvious logical nonsense. Say, "I am now in New York, ten seconds ago I was in Dubai, am I lying?". It's not surprising it identifies syntactical nonsense, the real interesting test is if it can abstract out errors between higher-level concepts that require actually understanding what is being said. Say, can it give a coherent answer to the question: "Peter was alive in 2010. He is alive in 2020, was he alive in 2015?" and so on.