5 ms·
That's hilarious, though it also demonstrates the AI Safety problem in another way - If true, Sam made a stupid mistake in assuming he could lie/fudge/exaggerat
by SkyMarshal 3y ago
That's hilarious, though it also demonstrates the AI Safety problem in another way - If true, Sam made a stupid mistake in assuming he could lie/fudge/exaggerate each board member's position to the others and that they wouldn't eventually talk amongst themselves and compare notes. That suggests he's either really not that smart, or he's overconfident and sloppy.
An AGI, or especially an ASI, would presumably avoid such easily-detectable mistakes. Things just start happening and seemingly disconnected events steer reality in a particular direction, and there is no way to concretely link them or discern their true provenance.
This is already exactly the problem with the most sophisticated disinformation campaigns run by the FSB/IRA/etc. It appears random, grassroots, and uncoordinated, and is difficult or impossible to discern its true provenance. But it all operates across a shared a set of objectives - increase social divisions, decrease trust in democracy and democratic institutions, and/or increase general irrationality and emotional response among the public.
If humans can already accomplish that, imagine what an ASI could do.
- JohnFen 3y ago> That suggests he's either really not that smart, or he's overconfident and sloppy. I think he's very obviously overconfident and sloppy.
- jychang 3y agoIt’s only overconfidence if he gets caught. This is the essence of playing poker- the bluffs need to be called for it to be a bad bluff.