I should note that square-error loss is not the only one that gives the average. Log-loss is another one, for example (you can prove it by taking the derivative

I should note that square-error loss is not the only one that gives the average. Log-loss is another one, for example (you can prove it by taking the derivative of your minimization, setting it to zero and solving)