5 ms·
This is pretty hard to read. For example, on the first page of chapter 1, it talks about "minimization of quadratic forms" and shows what looks like the formul
by throwaway81523 3y ago
This is pretty hard to read. For example, on the first page of chapter 1, it talks about "minimization of quadratic forms" and shows what looks like the formula for linear least squares. Is that right? It doesn't say anything about this. Some more exposition would help.
I do like that there are lots of exercises.
- guimplen 3y agoI think the text is geared towards people with some mathematical background who want to understand learning theory. Besides it is clearly stated that this chapter is a review (so its assumed that you learned or will learn these things elsewhere).
- throwaway81523 3y agoWell I have some math background but that section is brisk and slow at the same time, as it were. Such as how it explains how to find inverses of 2x2 matrices. This is older but is supposed to be good: https://www.deeplearningbook.org/ https://www.deeplearningbook.org/
- garydevenay 3y agoCertainly doesn't seem like first principles...
- bonoboTP 3y ago"First principles" doesn't mean "introduction". It is to contrast with anecdotal experience / tacit knowledge / empirical best practice approaches.
- nerdponx 3y agoThe sibling comment is right in that this is clearly not intended for first timers. But your instincts are correct here. When you write out the objective function for ordinary least squares, it turns out to be a quadratic form. The choice of the word "quadratic" here is not a coincidence: it is the generalization of quadratic functions to matrices. That section covers the vector equivalent of minimizing quadratic functions.
- wenc 3y agoLeast squares is quadratic. Quadratic means square terms.
- dawnofdusk 3y agoFirst principles doesn't mean easy to read unfortunately