3 ms·
Neural networks are powerful without even training them. By merely designing the structure of them you are creating something.
by oh_sigh 9y ago
Neural networks are powerful without even training them. By merely designing the structure of them you are creating something.
- theoh 9y agoTruly, an occasion for this koan: Sussman attains enlightenment In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6. “What are you doing?”, asked Minsky. “I am training a randomly wired neural net to play Tic-Tac-Toe” Sussman replied. “Why is the net wired randomly?”, asked Minsky. “I do not want it to have any preconceptions of how to play”, Sussman said. Minsky then shut his eyes. “Why do you close your eyes?”, Sussman asked his teacher. “So that the room will be empty.” At that moment, Sussman was enlightened. http://www.catb.org/jargon/html/koans.html http://www.catb.org/jargon/html/koans.html
- jacquesm 9y agoIf there ever was one this is it.
- thefalcon 9y agoOkay, I admit it, I'm not enlightened. Will somebody please Explain Like I'm 5?
- anchpop 9y agoInitializing a neural net with random weights =/= making a neural net with no preconceptions on how to play. It still has those preconceptions, you just don't know what they are. Closing your eyes so you can't see the contents of a room =/= the room is empty. Not knowing what something is, is different from it not existing
- thefalcon 9y agoThanks!
- ska 9y agoCreating is perhaps better states as “asserting”
- joshmarlow 9y agoThis kind of reminds me of what I took away from Gerald Edelman's work ([0]). The gist as I remember it was that he theorized that the cortex is composed of assemblies of neurons formed in development (in the womb, potentially with epi-genetic factors). Each assembly, just by chance of it's structure, is likely good at something. Over time, assemblies take up the tasks they happen to be good at and further specialize with experience. [0] - https://en.wikipedia.org/wiki/Neural_Darwinism https://en.wikipedia.org/wiki/Neural_Darwinism