4 ms·
Shouldn’t maximum information gain be found at maximal uncertainty: 50% ?? How is this different from information theory?
by orasis 7y ago
Shouldn’t maximum information gain be found at maximal uncertainty: 50% ??
How is this different from information theory?
- jacques_chester 7y agoLearning in this case is really about recall -- ensuring that information already captured is successfully retrieved. That's a different sense from learning as discovery, or at least, learning as search. In searching a graph of possible hypotheses, yes, it is a better rule to look for opportunities to halve the search space.
- Enginerrrd 7y agoI'd say no, because at that failure rate, there's nothing to be gained by learning over just guessing.