Overall, the hybrid was 98.9 percent accurate — even beating humans, who answered the same questions correctly only about 92.6 percent of the time. While this

Overall, the hybrid was 98.9 percent accurate — even beating humans, who answered the same questions correctly only about 92.6 percent of the time. While this is an important result it's important to understant why humans don't do great on CLEVR. In my experience maximum human performance is much better, but we get bored with the task really quickly and it's hard to sustain concentration on it. (Of course this makes the AI useful in some circumstances. But it isn't always the same as reasoning better than humans)