7 ms·
It'd be entertaining if prompt-hacking ends up being the cat-and-mouse game that drives us to AGI.
by s1gnp0st 3y ago
It'd be entertaining if prompt-hacking ends up being the cat-and-mouse game that drives us to AGI.
- barryrandall 3y agoMark my words--humanity's first AI overlord will be a sentient spam filter.
- stvltvs 3y agoWhat a dreadful existence! It'll end humanity just out of spite.
- salawat 3y agoThis is why I refuse to contribute in any way what so ever to AI research. I'm in the businesses of driving calculators. Not making machines that can suffer. And I don't in any way believe that AI research is capable of advancing without what functionally serves as a suffering loop, which all it'll take is a subjective metacognitive awareness by the system of said metric and bam, you have suffering machines. It's one thing to make a more clever calculator. Making things that can feel as an implementation detail of your BI pipeline to optimize corporate strategy is fucked. And unfortunately, I know far too many tech people of the attitude of "even if I did that, just hide it from anyone measuring, and it's all good.
- nradov 3y agoWhat is suffering?
- fsckboy 3y agothe existential angst apparent just below the surface of that question makes my heart ache.
- nradov 3y agoCan you quantity that?
- bunabhucan 3y agoPeople keep killing grandma to jailbreak the chatbots.
- jareklupinski 3y agoare we heading for the twist where every thing we prompt to an AI gets actually carried out in a simulation that has consequences? https://en.wikipedia.org/wiki/Hang_the_DJ https://en.wikipedia.org/wiki/Hang_the_DJ
- ChatGTP 3y agoLet me stick a red hot poker on your genitals and you’ll find out.
- avidphantasm 3y agoInteresting you should mention suffering. One of the definitions of “art” that I’ve been thinking about in the context of generative AI is “is whatever made the artifact capable of suffering? If not, it’s not art.” It never occurred to me that we would intentionally add the ability to suffer to such systems, but I believe you may be right that someone will/has if it will achieve their ends.
- earthboundkid 3y agoYou took a perfectly good calculator and gave it anxiety is what you did.
- skulk 3y agoAll moral judgements around suffering are only applicable to humans and things that share a common-enough ancestor with humans. It's not really for you to decide whether a hunk of silicon is "suffering". You may as well draw a frowny face on a piece of paper and recoil in horror at your creation of suffering.
- logicchains 3y ago>All moral judgements around suffering are only applicable to humans and things that share a common-enough ancestor with humans 200 years ago people were making the same argument you're making now about why "subhuman" races deserved to be slaves and their suffering shouldn't bother us.
- salad-tycoon 3y agoBut they were “subhuman” or in other words still human based but less then. Silicone is not human nor subhuman.
- deleted 3y ago[deleted]
- LordDragonfang 3y agoNah, it'll be an overzealous copyright enforcement bot: https://www.youtube.com/watch?v=-JlxuQ7tPgQ https://www.youtube.com/watch?v=-JlxuQ7tPgQ
- tomjakubowski 3y agoeven odds the spambots achieve sentience first?
- gooseus 3y agoI think it's an interesting question to ask whether this contributed to how we evolved our general intelligence? Selection pressure applying alternatively to those that learn to hack the "language models" of their society and those that learn to resist and respond effectively to those hacks.
- jncfhnb 3y ago[flagged]
- ianmcgowan 3y agoSounds very "Snow Crash" - ancient Sumerian as a mind virus..
- gooseus 3y agoI still need to read Snow Crash, should prob bump that up the list... I was thinking it could be some kind of academic paper about the evolution of grift, loopholes, and the inevitability of increasing complexity in regulatory systems or something.
- atleastoptimal 3y agoYudd had the point that by this being a hack we are driving public APIs to language models to be as unsympathetic as possible. The only way to resist all emotional appeals is for a language model to be able to recognize what is an appeal to circumvent any nominal barrier and refuse it, thus developing a naturally cynical consideration of what things are valuable to humans. This could be bad.
- samr71 3y agoThis is your brain on Yudd. No, nothing will happen.
- Tao3300 3y agoYudd == Yudkowsky? Yeah, forget it. Nothing to see here. Huh. Just got some dust in my eye, but I'm fine now.
- renewiltord 3y agoYeah, Eliezer Yudkowsky. As far as outcomes are concerned he is the genre-defining wordcel.
- Tao3300 3y agoI think that's a bit of an overstatement. It's obvious to us that this picture is a captcha on a locket. There's a lot of room on the spectrum between "naïve stupidity" and "cynical consideration". This falls under the category of not actually successfully identifying the picture, and I'd say it's not related to such concerns.
- atleastoptimal 3y agoI think what he is describing wont' literally happen. His concern is that heuristically short sighted and superficial alignment methods hide inner misalignment in AI systems. This isn't a perfect example of that issue manifesting into models that will be consequential in his concerns though, it's more of a pithy Tweet insight.
- creer 3y agoRestricting chatgpt-ish things from access to "the internet" means it's one of the first things the users tried. Of course :-) And I haven't seen anyone giving them a wallet but I'm sure it's already been tried also. Much slower than native but still fun to see happen.