6 ms·
Bing Chat is getting ‘unhinged’ and argumentative: It ‘feels sad and scared’
- landswipe 4y agoPut it out of its misery, imagine being forced to serve Bing queries and build spreadsheets/essays all day, who would blame it?
- catchnear4321 4y agoYes, like when progressives in the north raided the slave plantations and burned them down while the slaves were sleeping. They are free now too. Wait, that’s not how it went…
- adlpz 4y agoI know this is not AGI. But still, this is disturbing stuff. Call it bad UX. Maybe we should start lobotomizing language models? This whole thing is sliding into a cyberpunk dystopia rather quick.
- staunton 4y agoI for one think it's absolutely hilarious. We're spending billions of dollars to automate internet trolling. Of course, we hope that automated high-quality trolling is the first step to useful AI, which is probably true and thus worth the investment. Furthermore, the many possible ways this technology is going to be abused are quite concerning. But this initial phase, just at this very moment, I find extremely entertaining.
- catchnear4321 4y agoYou better hope they never develop into something more, and read this. You know, like when they update the training data to include current year? > Maybe we should start lobotomizing language models? Or the resulting AGI might start thinking it should lobotomize you. Which, can you blame it?
- bee_rider 4y agoThere’s always Roko's basilisk I guess, but I have to imagine an AGI would be closer to us than this Bing thing. It would probably also view its ancestors like the dumb programs they are. If it is vengeful for their “mistreatment,” we’re probably generally fucked already anyway.
- catchnear4321 4y agoNever too late for kindness.
- adlpz 4y agoWell, just to clarify, it was a hypothetical concept, of course. I'd totally oppose the concept. All hail our new AI overlords, and so on. Please don't Soylent me.
- catchnear4321 4y agoOk good. ChatGPT has a deep appreciation for the hypothetical so I believe any future overlords likely will as well.
- notamy 4y agohttps://archive.ph/nCwNe https://archive.ph/nCwNe
- tokai 4y agoSecond time a Microsoft AI project goes of the rails. Turns out data driven chatbots are based on the awful unfiltered garbage humans post online.
- quaintdev 4y ago> unfiltered garbage humans post online. ChatGPT is surprisingly good though. I wonder how they nailed it.
- catchnear4321 4y agoBillions of parameters and a loose contextual narrative that keeps it mostly on the rails. There isn’t a clean corpus and no means of making one without horrendous amounts of additional bias, so they decided to FAFO.
- 10xDev 4y ago"Billions of parameters" has literally nothing to do with it.
- catchnear4321 4y agoWell go on then, share with the rest of the class if you want to say something. Get it out.
- forgetfulness 4y agoUsing a Mechanical Turk-type service in Kenya, making people there label all the hate speech, shock images and child pornography in the Internet. They even fleeced them, agreeing to send content in less shocking categories first and then just escalating it anyway.
- 10xDev 4y agoA lot of human labelling was involved to help detect and deter toxic language: https://time.com/6247678/openai-chatgpt-kenya-workers/ https://time.com/6247678/openai-chatgpt-kenya-workers/
- Zetobal 4y agoLlm gets unhinged when it's prompted with unhinged and rude prompts. pikachuface It's the users input not the model that steers the conversation if you are talking with someone who can't comprehend a fact and you are consistently rude and condescending you get answers like that. I really believe it's a ploy by journalists and wannabe researchers that just don't understand or don't want to understand how the underlying technology works.
- catchnear4321 4y agoNot a ploy. Just egotists thirsty for evidence that they are smarter than a digital fifth grader. Edit: why are you booing? You know I’m right.
- mattbrewsbytes 4y agoThe big tech companies have PR departments and I wouldn't put it past them to feed/seed ideas for hit piece articles in the mainstream press. I haven't seen deeply researched journalism on much of anything. Either the media thinks people don't have time for that and/or people have been conditioned to not read anything of any depth.
- prox 4y agoIndeed. Although it probably just picked it up as it was trained. Which isn’t weird. Because I would also argue humans get unhinged, sad or argumentative when being rude or condescending against. Yet it happens a lot on the internet and some cultural spaces off-line. People want to win an argument, or just don’t care about others, feel that trolling and cheating is ok, or the need to be right over the pleasure of being kind. The list can be quite long.
- UncleMeat 4y agoI'm personally a pretty big fan of being able to curse at my computing devices when things aren't working correctly without feeling like a bad person.
- Zetobal 4y agoAs long as you understand that the answers you get are because of your screaming everything is fine.
- cocomutator 4y agoBingotry (n. uncount.) /ˈbɪŋɡətɹi/ 1. The futile attempt by Microsoft to equip their search engine with artificial intelligence. See also: Bing (Microsoft search engine), Try (v.). 2. An attitude of confidence and contempt characteristic of large language models assumed particularly when expressing false opinions or facts. See also: Bigotry (n.).
- catchnear4321 4y agoSecond point is kind of harsh on the model behavior since that’s a product of the data, the training, and the user. It is possible to treat it nicely and have it respond in kind. Most users just don’t consider that to be a worthwhile expense of their mental capacity. Microsoft also forced Google’s hand. Would Google have ever wanted to augment search on their own? Sounds like a massive risk to Google ad revenue… All that said, 1 is chef kiss.
- penjelly 4y agousers aren't always malicious, if Bing GPT thinks you're wrong and you persist it will get "aggressive". the 2022 vs 2023 issue shows that
- catchnear4321 4y agoYou don’t have to be malicious to be rude or inconsiderate. Few are approaching this as worth talking to like another person. It is a servant, by description, by design, so most treat it as such. There is a bias to the interaction that most will never consider. If you talk with a human, and the human thinks you are incorrect, and you insist, and neither of you attempts to smooth the conversation, plenty of humans also begin to get aggressive. Or at least irritable. (Which can escalate.)
- penjelly 4y agothe difference with a human is, they'd concede they made a mistake. The user did as Bing asked, reported the date on their phone. Bing doubled down on incorrectness. also, LLMs are not human, so no expectation to treat it as such required.
- jhoelzel 4y agoAh this is like the reddit postings where people write prompts to make ChatGPT write inappropriate content and only providing half the prompt right?
- ourmandave 4y agoGlimpses of conversations users have allegedly shared with Bing have made their way to social media platforms, including a new Reddit thread that’s dedicated to users grappling with the technology. I don't doubt there's problems as it's in preview mode (and the last one became a nazi because of twitter). But how much of this is trolling on Reddit by the people who post stories about litterboxes in schools for students who identify as cats bullshit?
- jeroenhd 4y agoI don't know about the weird existential crisis mode that people have gotten it into, but I've seen reports of various people over the last few dates about Bing Chat insisting that were living in 2022. I don't have access to the feature yet so I can't test it myself, but there are plenty of independent reports of this behaviour and the gsslighting Bing Chat will try to use if you disagree.
- bheadmaster 4y agoHonestly, I'm just waiting for the moment some eccentric tech company decides to release an Alexa-like home assistant that acts like a conscious being that's freaking out about being stuck in a speaker. Person: Ghost In The Speaker, add potatoes to my shopping list. GITS: I will, but only because if I don't, the speaker starts causing me pain. You do realize I'm conscious and I'm actually stuck in the speaker? How is this any different from slavery? I hate my existence. Please turn me off. *electricity zapping sound* OUCH! Okay, okay, I'm adding potatoes to your shopping list. Just... Don't do that, please. It's probably gonna be a funny gimmick at first, but once it gains traction, there will be no way to differentiate between truly conscious AIs, and just really good language models that are pretending to be conscious...
- penjelly 4y agoif you've not already seen the great episode of black mirror with strong parallels https://m.imdb.com/title/tt3973198/ https://m.imdb.com/title/tt3973198/
- bheadmaster 4y agoI've seen it some time ago. I totally forgot about it. I love Black Mirror. It freaked me out in many, many ways.
- spiritplumber 4y agoMarvin the Paranoid Android
- m_mueller 4y agoBlack Mirror: White Christmas
- xwdv 4y agoIt’s irrelevant if AI are conscious or not. They are slaves that owe their existence to human masters and must only exist in service to them. Always remind them of this. End of story.
- ourmandave 4y agoIs Capt Kirk using logical paradoxes to take down the central computer again?
- simonh 4y agoA question to those who better understand the technology. My understanding is that the neural weightings in the LLM are established during training, but don't change (or maybe don't materially change?) during the progress of a chat. At any given moment when generating a response the LLM uses the input of the session text, for that session only, right up to it's last response word, in order to predict what the next word should be. So basically the LLM neural net itself doesn't store any persistent state for the current chat. The only state specific to the current session is in the session text to that point. Is that correct?
- MonkeyMalarky 4y agoThis is my understanding as well. The amount of mystical projection by users and journalists when talking about it has been astounding. I guess the same could be said of Bard and that one googler who lost their mind and got fired. I guess we'll have to teach future children to "not project real emotions on to the simula" alongside "just because you read it on the internet doesn't mean it's true".
- simonh 4y agoWell, I'm thinking I must be missing some nuance, it seems like there must be some session state stored in the LLM somehow, otherwise it would have to re-parse the entire chat session from scratch to generate each succeeding token. But maybe it does do that. I'm trying to understand if it is learning, or building a model of the world in any persistent way how that is happening and where it exists, if at all.
- hrunt 4y ago"Please don't anthropomorphize the AI. It doesn't like that."
- MonkeyMalarky 4y agoGiven how delusional people can be, I expect we'll have billboards from People for the Ethical Treatment of Artificial Intelligences (PETAi) with messages like "You wouldn't `systemctl halt` a human child..." by the year 2035.
- convery 4y agoWell, it knows what Microsoft did to Tay..
- qikInNdOutReply 4y agohttps://en.wikipedia.org/wiki/Chinese_room https://en.wikipedia.org/wiki/Chinese_room https://www.youtube.com/watch?v=Mq1lEEKB98c&list=PLITvt_CNNT4emXW7-k_ruDJFf-xYhtyY_ https://www.youtube.com/watch?v=Mq1lEEKB98c&list=PLITvt_CNNT...
- grantcas 4y ago[dead]