3 ms·
The cynic in me says that the #1 AI-related risk by far is that corporations will immediately apply it to the task of listening in on everything we say and writ
by jiggawatts 4y ago
The cynic in me says that the #1 AI-related risk by far is that corporations will immediately apply it to the task of listening in on everything we say and write.
This all reminds me of "A Fire Upon the Deep" by Vernor Vinge, where the Slavers enslave humans by essentially constantly monitoring them for misbehaviour. If I remember correctly, a plot element is that they use yet more slaves to keep the bulk of the slaves in line.
With ChatGPT, you no longer need to do "sci fi things" like turning squishy meat brains into cyborg slavedrivers. You can simply ask the AI to do it, and it will. It will do it 24/7, without pity, or remorse. It will do vigilantly and faithfully.
It will be a checkbox in Office 365 that any psychotic manager can turn on.
And I guarantee they will turn it on.
All of them.
- ben_w 4y agoI've not yet had time to read/listen to A Fire Upon the Deep yet, only its sequel A Deepness in the Sky, but that certainly sounds like one of the many bad endings we might get. That said: > With ChatGPT, you no longer need to do "sci fi things" like turning squishy meat brains into cyborg slavedrivers. You can simply ask the AI to do it, and it will. It will do it 24/7, without pity, or remorse. It will do vigilantly and faithfully. ChatGPT has all the vigilance and faithfulness of my late mother's mid-stage Alzheimer's, so if someone tried this today it would rapidly result in everyone getting million-dollar-no-work-required contracts the company isn't allowed to break. That LLMs can be socially engineered just by asking nicely is a pleasant surprise twist in AI alignment, but unfortunately I think it illustrates how primitive is our current state of the art AI safety and alignment.