Nice tutorials and reference resources. One note, which may be confusing for beginning learners: why to choose one fitting method (e.g. least squares) over ano

Nice tutorials and reference resources. One note, which may be confusing for beginning learners: why to choose one fitting method (e.g. least squares) over another (e.g. gradient descent)? Especially so, as libraries often pack a lot of alternatives.