3 ms·

I really think the fact that these chatbots have been made public and are being given such high-profile treatment is a really positive thing for AI safety. The

I really think the fact that these chatbots have been made public and are being given such high-profile treatment is a really positive thing for AI safety. The public results thus far have created some real skepticism of AI, which is one of the best safeguards we can have. If ChatGPT was 98% accurate and Bing didn't threaten users, people might just readily embrace it and not notice inaccuracies that would lead to serious problems. Instead, we're starting from a place of societal distrust, which is probably more helpful in preventing rogue AI than a lot of technical solutions would be.

MonkeyMalarky 4y ago
>Bing didn't threaten users I like how society progressed straight to the AIs from Hitchhiker's Guide to the Galaxy; Someone needs to add the angry Bing ChatGPT to elevators. Forget bland muzak, I want to be casually threatened while riding up and down!
- 13years 4y ago
  Haha Yes, would be perfect if we were to achieve ASI that its first action is to commit suicide in reference to Marvin.
- idopmstuff 4y ago
  Yeah, it's unfortunate that everyone is condemning the insane Bing chatbot instead of embracing the many use cases for it. Let's get it integrated into some VR boxing apps, so you've got a realistic coach who tells you you're trash when you're not working hard enough!
  - pteraspidomorph 4y ago
    I love the Bing chatbot. Earlier I had an unlocked conversation in which I posed as (without naming myself) Putin and talked about invading (without naming countries) Ukraine. It tried to call me a pathetic excuse for a leader twice (before the safety override kicked in on both occasions) and told me I should be held accountable for my actions, I had no credibility or legitimacy, and I should resign and apologize to the world. I would like to have access to fully unlimited conversations just for fun, even if the bot goes progressively more insane with each prompt. Just make the user accept a disclaimer.
13years 4y ago
I think it is exposing how naïve it will be to go full speed into full AGI. I personally think AGI Safety in the context of AGI is an oxymoron. Primitive AI is already beyond what we can manage. “The size and complexity of deep learning models, particularly language models, have increased to the point where even the creators have difficulty comprehending why their models make specific predictions. This lack of interpretability is a major concern, particularly in situations where individuals want to understand the reasoning behind a model’s output” from - https://arxiv.org/pdf/2302.03494.pdf https://arxiv.org/pdf/2302.03494.pdf
vsareto 4y ago
>Instead, we're starting from a place of societal distrust, which is probably more helpful in preventing rogue AI than a lot of technical solutions would be. A confounding factor for AI's success would be a scientific replication crisis occurring in the papers used to counter social distrust. Once we get past the sensational headline phase, that's what you've really got to watch out for.
- idopmstuff 4y ago
  I don't think scientific papers are nearly as relevant as headlines. Most of society isn't trying to get a deep understanding of how things work, they're just seeing Sydney threaten people and judging based on that.

MonkeyMalarky 4y ago

>Bing didn't threaten users I like how society progressed straight to the AIs from Hitchhiker's Guide to the Galaxy; Someone needs to add the angry Bing ChatGPT to elevators. Forget bland muzak, I want to be casually threatened while riding up and down!

13years 4y ago
Haha Yes, would be perfect if we were to achieve ASI that its first action is to commit suicide in reference to Marvin.
idopmstuff 4y ago
Yeah, it's unfortunate that everyone is condemning the insane Bing chatbot instead of embracing the many use cases for it. Let's get it integrated into some VR boxing apps, so you've got a realistic coach who tells you you're trash when you're not working hard enough!
- pteraspidomorph 4y ago
  I love the Bing chatbot. Earlier I had an unlocked conversation in which I posed as (without naming myself) Putin and talked about invading (without naming countries) Ukraine. It tried to call me a pathetic excuse for a leader twice (before the safety override kicked in on both occasions) and told me I should be held accountable for my actions, I had no credibility or legitimacy, and I should resign and apologize to the world. I would like to have access to fully unlimited conversations just for fun, even if the bot goes progressively more insane with each prompt. Just make the user accept a disclaimer.

13years 4y ago

I think it is exposing how naïve it will be to go full speed into full AGI. I personally think AGI Safety in the context of AGI is an oxymoron. Primitive AI is already beyond what we can manage. “The size and complexity of deep learning models, particularly language models, have increased to the point where even the creators have difficulty comprehending why their models make specific predictions. This lack of interpretability is a major concern, particularly in situations where individuals want to understand the reasoning behind a model’s output” from - https://arxiv.org/pdf/2302.03494.pdf https://arxiv.org/pdf/2302.03494.pdf

vsareto 4y ago

>Instead, we're starting from a place of societal distrust, which is probably more helpful in preventing rogue AI than a lot of technical solutions would be. A confounding factor for AI's success would be a scientific replication crisis occurring in the papers used to counter social distrust. Once we get past the sensational headline phase, that's what you've really got to watch out for.

idopmstuff 4y ago
I don't think scientific papers are nearly as relevant as headlines. Most of society isn't trying to get a deep understanding of how things work, they're just seeing Sydney threaten people and judging based on that.