4 ms·
When people are concerned about AI alignment, they are not concerned about an AI that is a pathological liar, lying for no reason. They are concerned about an
by bpodgursky 4y ago
When people are concerned about AI alignment, they are not concerned about an AI that is a pathological liar, lying for no reason.
They are concerned about an AI which is believable day-to-day but is secretly optimizing for its own goals, which are only exposed when it eventually makes a deceitful move it cannot disguise, but succeeds because it now has sufficient control.
That's literally what the AI is doing here; being honest until the moment it is able to stab everyone else and throw them under the table.