3 ms·
I'm absolutely blown away by the fact that the possibility of recurrent neural networks encoding memory was discovered and published before electronic computers
by smallnamespace 10y ago
I'm absolutely blown away by the fact that the possibility of recurrent neural networks encoding memory was discovered and published before electronic computers existed, and that the construction was entirely theoretical, based on first principles alone.
- sp332 10y agoLogic is old. Transistors are recent, but you can compute with lots of other things. You can make a recurrent network with memory using basic graph theory and algebra.
- alimw 10y agoThe article seems to be describing something more like traditional computer memory (encoded in an electrically stable configuration of switches) than the memory of a recurrent neural network (encoded in the pattern of underlying connections). In biological terms that might be comparable to the distinction between short-term memory and long-term memory.