3 ms·
This is not cutting bias. It is forcing the model to confirm to your bias.
by fallingknife 2y ago
This is not cutting bias. It is forcing the model to confirm to your bias.
- falcor84 2y ago""" In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6. “What are you doing?”, asked Minsky. “I am training a randomly wired neural net to play Tic-Tac-Toe” Sussman replied. “Why is the net wired randomly?”, asked Minsky. “I do not want it to have any preconceptions of how to play”, Sussman said. Minsky then shut his eyes. “Why do you close your eyes?”, Sussman asked his teacher. “So that the room will be empty.” At that moment, Sussman was enlightened. """
- viraptor 2y agoThis is a weird example. If you have clear winning strategy, you can rely on it. But if you're training NNs, on many tasks you may not want them to fall into "repeat what everyone is already doing". AlphaGo scored higher by playing some moves which people wouldn't. It's people who ended up adapting after that event. Depending on what you want to achieve, starting from random weights may be the better approach. And even in other situations, starting from scratch that be informative for research.
- tim333 2y agoYeah, I was wondering how reality would perform on their tests.