5 ms·
I found that the statement about the cross entropy not true. When y==a the function is non-monotonic with 0 at the extremes but not at the middle. So the "proof
by kghose 12y ago
I found that the statement about the cross entropy not true. When y==a the function is non-monotonic with 0 at the extremes but not at the middle. So the "proof" shown is confusing to me.
- michael_nielsen 12y agoWhich statement about cross entropy is confusing?
- kghose 12y agoHi! The statement "if the neuron's actual output is close to the desired output, i.e., y=y(x) for all training inputs x, then the cross-entropy will be close to zero" is not true. The function peaks in the middle (~ 0.7) Thanks! -Kaushik
- michael_nielsen 12y agoThis is addressed in the marginal note attached to the sentence you quoted. The essential point is that we're considering classification problems, for which the output is intended to be 0 or 1. I address the more general case of regression problems (where y may take any value) in a later exercise. Hope that helps!
- kghose 12y agoI see it now, thanks!