3 ms·
Randomly wired networks reminds me of a classic AI koan: > In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6. > “W
by monocasa 6y ago
Randomly wired networks reminds me of a classic AI koan:
> In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6.
> “What are you doing?”, asked Minsky.
> “I am training a randomly wired neural net to play Tic-Tac-Toe” Sussman replied.
> “Why is the net wired randomly?”, asked Minsky.
> “I do not want it to have any preconceptions of how to play”, Sussman said.
> Minsky then shut his eyes.
> “Why do you close your eyes?”, Sussman asked his teacher.
> “So that the room will be empty.”
> At that moment, Sussman was enlightened.
- optimalsolver 6y agoExcept random search was found to outperform state-of-the-art neural architecture search algorithms: https://arxiv.org/abs/1902.08142 https://arxiv.org/abs/1902.08142
- greatgoat420 6y agoThe story is more about how a random set of weights WILL have preconceptions of how to play. If you look at condition numbers or spectra of random normal matrices they are very much not random.
- ad404b8a372f2b9 6y agoI don't see how that relates. You don't stick to a single random wiring, you only make the wiring random so that the space of possible wirings of the network is not constrained by the classical sequential paradigm.