Yes this is the type of implementation that inspired the idea. Now with cheap and tiny microcontrollers each neuron can be self contained and handle it’s own we

Yes this is the type of implementation that inspired the idea. Now with cheap and tiny microcontrollers each neuron can be self contained and handle it’s own weights without need for external memory or components. The GreenArray chip mentioned by another poster seems to fit this though each core is only directly connected to 4 others you could work around that limitation by having a layer of routing cores that pass messages from one neuron layer to the next.