The fact that any single human will not be able to understand how such AI works to the minimal detail, means nothing about the way such AI can be created. For

The fact that any single human will not be able to understand how such AI works to the minimal detail, means nothing about the way such AI can be created. For example: Evolutionary programming, Iterative design, Gödel Machines. All of them possible approaches.