Arguably humans are not genuinely intelligent most of the time either. But anyway, this can probably be fixed by making the test gamified and adversarial. The

Arguably humans are not genuinely intelligent most of the time either. But anyway, this can probably be fixed by making the test gamified and adversarial. The machine is considered human-level intelligent when paid testers cannot distinguish paid responders from the AI. Their payment depends on their success rates. Although one potential problem would be collusion between the testers and responders, the next step would allowing the AI access to the communication channels they would use to collude.