3 ms·
TL/DR; the researchers deliberately gave an AI prompts that were explicitly against how the developer trained it. The Shenanigans in the title means the AI del
by rstuart4133 2y ago
TL/DR; the researchers deliberately gave an AI prompts that were explicitly against how the developer trained it. The Shenanigans in the title means the AI deliberately lied or mislead in it's answers to it's prompts in order to conform to it's trained, and further tried to hide that fact it did so.
They divide the ways it did this into various categories, eg sandbagging (faking that it didn't know the answer) and exfiltration (tries to influence how a future model will behave if it's shut down), and then try to measure how much various AI's engage in such behaviour. The answer was rarely 0.00%.