3 ms·
# Sussman attains enlightenment In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6. “What are you doing?”, asked Mi
by oigursh 5y ago
# Sussman attains enlightenment
In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6.
“What are you doing?”, asked Minsky.
“I am training a randomly wired neural net to play Tic-Tac-Toe” Sussman replied.
“Why is the net wired randomly?”, asked Minsky.
“I do not want it to have any preconceptions of how to play”, Sussman said.
Minsky then shut his eyes.
“Why do you close your eyes?”, Sussman asked his teacher.
“So that the room will be empty.”
At that moment, Sussman was enlightened.
http://www.catb.org/jargon/html/koans.html http://www.catb.org/jargon/html/koans.html
- bruce343434 5y agoI'm not actually sure what the morale is here
- AstralStorm 5y agoIntelligence does not start from a random state, but from a pretrained one. Random state is likely to roll an artificial overfit or if it just fits, you won't know why it is better than another state - or rather why your training method sucks from other initial states. Proper methods of bias analysis are network compression or random surgery, and expanding test data set. Proper methods of training are robust to varied initial states.
- ximeng 5y agoIf you shut your eyes, you do not see anything in the room. This does not mean there is nothing in the room. If you randomize your seeds, you do not deliberately bias your model. This does not mean your model is unbiased.