2 ms·
Don't try and explicitly rule out humanity. That's sort of impossible because some humans are smart and can strategically lie to emulate a machine's expected be
by logicalmonster 3y ago
Don't try and explicitly rule out humanity. That's sort of impossible because some humans are smart and can strategically lie to emulate a machine's expected behavior. If you ask a suspected AI those woke diversity questions to try and prove its an AI, smart humans will fool it by answering in the way they'd expect a corporate AI to be programmed in.
Instead, give it a task machines excel at, namely doing math fast, that nobody but some weird "Rain Man" savant can even come close to doing.
Give it a list of numbers to perform some easily understandable mathematical operation on. A human would have a hard time providing the answer of say 100 square roots and multiplying each of those values by the digits of PI sequentially in under 10 seconds or some such contrived example, but that seems pretty doable for a machine. Even a world-class expert programmer answering this question would have a hard time writing a custom script to solve this in some extremely short amount of time.
The hard part might be distinguishing between unintelligent bots/scripts and actual AI, so you might need to combine a few tests to both prove some form of intelligence, as well as prove that it's an AI rather than a script.
You might also want to continuously test the AI by possibly doing something like providing a short lived JWT token and repeatedly challenging it over time to stay onboard. A smart human might be able to arrange to fool even a very hard test once, but can't sit around the clock continuously solving repeated challenges to stay on your service over time. Some smart human might manage to fool you once, but will not be able to solve repeated tests over time without slipping up at some point.