3 ms·
This is one item on my long list of flaws with AI. OpenAI thinks that as long as you aren't using dating terminology or asking to build bombs, you're probably
by gjsman-1000 1y ago
This is one item on my long list of flaws with AI.
OpenAI thinks that as long as you aren't using dating terminology or asking to build bombs, you're probably safe.
- What does having an unquestioning mirror that is always gracious and reflects your own biases back at you, do to the mind in the long term? We don't know.
- How do you know, that after 2-3 years of this use, without any particular warning, it will not suddenly escalate into a delusion spiral? We don't know.
- Does this affect childhood development to have no pushback on their personal feelings and opinions? We don't know.
- Does this affect people's very willingness to learn, and to endure intellectual struggle? We don't know.
- Does this affect long-term retention, as losing even an imperceptible 2% of your knowledge every month, is 48% lost after 2 years? We don't know.
- How does this affect a population of which 27% have experienced a mental health issue in the last year, and of which 9% are experiencing depression? We don't know.
- Are all these problems solvable with any amount of education or warning labels, given that human nature has not changed and will not change? We don't know.
- Can this be prevented with any amount of AI guardrails or ethics training, or is it inherent to the structure of the system itself? We don't know.
- Will this eventually be considered so dangerous, that we need black-box warning labels similar to cigarettes and possibly social media? We don't know.
- Will this eventually be considered so insolvably risky for human cognition, that we outright restrain use without a license, either like driving at best, or asbestos at worst? We don't know.
- Will any employer be able to obtain insurance for AI use, if there is even a 0.2% documented chance that any employee could go psychotic from using it, completely at random? We don't know.
- Will said employees, if they do go psychotic from a work-mandated AI chatbot, successfully sue their employers for damages? We don't know.
- cyberpunk 1y agoThe latest South Park episode had a fairly funny bit about this whole thing, so I think we (society in general, I mean) are aware of this. I don't think there are any easy answers to prevent people getting sucked into these sort of problems though. I mean, look at how much people shared on social media back in its early days. Stories are coming out every week about how people have been waylaid by these properties. Education I guess is the answer, but we don't even seem to be able to properly educate children about pornography and social media, let alone the subtleties of interacting with AIs..
- gjsman-1000 1y ago> Education I guess is the answer If these are real problems, hell no, because education has never forced anyone to do anything right. You can yell about the dangers of STDs until you are blue in the face, but 20% of the population carries one. You can yell about the dangers of speeding just 5 MPH with graphic imagery in drivers ed, but 35% of adults go 10+ MPH over in residential areas every month. The answer, quite literally, is possibly age verification, outright bans, or mandatory licensing. None of which are priced into the stock market. However, any government will quickly realize that having up to a quarter of your population vulnerable to developing psychosis and mental problems (due to 27% of the population experiencing at least some form of mental illness just in the last year, making them presumably more vulnerable to AI) is absolutely literally financially impossible to allow freedom in experimenting with.
- cyberpunk 1y agoSo .... your argument is that we shouldn't educate children about STDs because some people ignore that? So what then, ban sex? Good luck. Education is really the only answer here. There are clearly challenges in doing it right but fucked if I don't think it'd be worse not to even try...
- gjsman-1000 1y agoYou're acting like human nature, wanting the easy way out, is something that can be overcome by education. It can't. Full stop. It needs to be a choice of the people involved, to do the hard good thing, unless it is otherwise imposed on them. We enjoy "freedom" in the sense that the good choice is often not imposed, because enough people make the good decision regardless. If AI successfully convinces enough people to not make that choice, despite all the lecturing on why you should make the proper choice, we're screwed unless we clamp down hard. I do know that a society with the level of cognitive dependency that AI risks introducing, and is already introducing, literally cannot function without collapse. Do you want a society intellectually dependent on advanced manufacturing techniques in one of the most geopolitically at-risk regions of the world?
- rsynnott 1y ago> What does having an unquestioning mirror that is always gracious and reflects your own biases back at you, do to the mind in the long term? We don't know. We _kind_ of do: https://en.wikipedia.org/wiki/Folie_à_deux https://en.wikipedia.org/wiki/Folie_à_deux Though I suppose this is more Folie à Un.