5 ms·
This. There is information encoded in the relative connections of neurons, so a neuron firing doesn't represent a single flop, it represents something more like
by BobbyJo 4y ago
This. There is information encoded in the relative connections of neurons, so a neuron firing doesn't represent a single flop, it represents something more like a flop + a routing table lookup + n number of other flops where n is the number of destination neurons spiked. Depending on how much information is encoded in the table lookup, and how many destination neurons are effected, a single neuron firing can represent many many flops.
This is all armchair speculation, but I'd be willing to be my life that a flop is well below the floor of actual computation happening from a single neuron firing.
- lostmsu 4y agoI don't believe there's a "routing table lookup" in a single neuron firing. Once it fires all downstream neurons get signal.
- BobbyJo 4y agoThe neuron itself and its downstream counterparts are what I was considering the table lookup. In computers the address a value is stored at doesn't encode information. Only the value held at the address matters. Not so with neurons. How the connections form and who they are connected to represent compound operations. Like passing a value through separate preconfigured pipelines.
- pyinstallwoes 4y agoI agree. There is also information when it's not firing, the pause between is information itself, almost infinite which is odd to think about. It seems similar to music/geometric shape. Queries by frequency filtering through the geometry of the neurons activating access to some thought-space.