there's a funny paper on this theme, titles "Could a Neuroscientist Understand a Microprocessor" https://pmc.ncbi.nlm.nih.gov/articles/PMC5230747/ https://pmc.

there's a funny paper on this theme, titles "Could a Neuroscientist Understand a Microprocessor" https://pmc.ncbi.nlm.nih.gov/articles/PMC5230747/ https://pmc.ncbi.nlm.nih.gov/articles/PMC5230747/ roughly, it reviews common techniques in neuroscience, and comes to the conclusion that they would not be able to understand even simple computing platforms that we have perfect information for (and can perfectly stimulate any internal connection, can perfectly read out the values on any internal connection, etc).