>The government’s National Institute of Standards and Technology will develop a uniform framework for assessing safety, as part of the order Biden signed in Oct

>The government’s National Institute of Standards and Technology will develop a uniform framework for assessing safety, as part of the order Biden signed in October. They probably need to develop an extremely antisocial, psycopathic, malevolent AI to assess other AIs for safety. Its purpose will be to run through thousands of scenarios, using manipulation, threats, and deception to try to extract dangerous information from the other AI. It can then score the responses based on the information it was able to extract. I don't really see any other way to automate this extremely tedious and error prone task. It's interesting though because we will need to concentrate all of the evil in the world into a single AI in order to run these tests.