4 ms·
If freely wired neutral networks are DAGs, I wonder how cyclic graphs of neurons behave, or even if that model would be theoretically meaningful, or computation
by mpoteat 6y ago
If freely wired neutral networks are DAGs, I wonder how cyclic graphs of neurons behave, or even if that model would be theoretically meaningful, or computationally feasible.
- goldenkey 6y agohttps://en.wikipedia.org/wiki/Boltzmann_machine https://en.wikipedia.org/wiki/Boltzmann_machine You generally run them until they settle down. You can train them, in a difficult process, by using the idea of thermal equilibrium.
- LeegleechN 6y agoYep, they've existed for decades. Look up "RNN" (recurrent neural network) and "LSTM" (long stort-term memory). They were the standard for neural-network based time-series processing for a while until recently supplanted by Transformers.