3 ms·
I would argue that 'greedy' applies to neutral networks in a different sense: they seize on their first solution; they have no mechanism to re-evaluate a decisi
by mcguire 9y ago
I would argue that 'greedy' applies to neutral networks in a different sense: they seize on their first solution; they have no mechanism to re-evaluate a decision that is proving false.
- hadsed 9y agoSure they do, it happens at training time. Each time you update parameters you look at all your predictions and figure out how well you did. That informs your next tweak to the parameters. Run online training and you are constantly doing this.