This is a simplistic view of what is going on. That complexity is not produced by 1e6 neurons alone. Rather it is a combination of a neural net embedded in a bi

This is a simplistic view of what is going on. That complexity is not produced by 1e6 neurons alone. Rather it is a combination of a neural net embedded in a biochemical harness. The harness interacts not only with individual bee's systems, but also with environment and other bees (via pheromones, etc.) I do agree with you that we still have much to learn in neural network design (or more generally distributed algorithms). For example distributed systems are notoriously bad at state machines (or sequencing in general). One of the ways biological systems handle sequencing is via multiple signaling layers with different time constants (e.g. pheromones vs neurons). On the other hand deep learning systems I am familiar with just throw more parameters at the problem, obviously this scales poorly with the sequence length.