Occam's razor is a very very bad principle to bank on when reverse-engineering AI models because approaches which we consider "simple" (likely in a "natural" co

Occam's razor is a very very bad principle to bank on when reverse-engineering AI models because approaches which we consider "simple" (likely in a "natural" context) could be very different from what some high-dimensional statistical model trained on a large data corpus considers simple. Eg: If Occam's razor applied reasonably, then adversarial examples wouldn't be a thing. Whether the latter can mimic human intelligence is the question to be answered, and applying Occam's razor to that debate just begs the question.