This is addressed in the marginal note attached to the sentence you quoted. The essential point is that we're considering classification problems, for which th

This is addressed in the marginal note attached to the sentence you quoted. The essential point is that we're considering classification problems, for which the output is intended to be 0 or 1. I address the more general case of regression problems (where y may take any value) in a later exercise. Hope that helps!