3 ms·
It's an OK explanation of a PID controller. They're easy to code; tuning is the hard part. There are lots of approaches to tuning. This author offers a simple o
by Animats 7y ago
It's an OK explanation of a PID controller. They're easy to code; tuning is the hard part. There are lots of approaches to tuning. This author offers a simple one.
I note that he cites "James Clerk Maxwell: “On Governors”. Proceedings of the Royal Society, #100,1868".[1]
Yes, 1868. Yes, that Maxwell, of Maxwell's Equations. That paper is worth reading. Right there, linear control theory was born. And that's about where the state of the art was until 1950 or so.
Modern control theory is closely tied to machine learning. Except that the control theory people want solutions that don't suddenly do funny stuff for some inputs. The math is way beyond me. Even control theory PhDs have trouble now.
[1] https://www.maths.ed.ac.uk/~v1ranick/papers/maxwell1.pdf https://www.maths.ed.ac.uk/~v1ranick/papers/maxwell1.pdf
- senderista 7y agoSpecifically, reinforcement learning is closely related to optimal control theory.
- jbay808 7y agoI think there are some important steps between Maxwell and 1950 that are worthy of mention. Black's paper on negative feedback amplifiers, for one; the invention of the PID controller itself, for another...
- Animats 7y agoMaxwell had P and I, but not D. Derivatives are hard to do mechanically, tend to be noisy, need filtering, and thus have lag. An aircraft vertical speed indicator is one of the few widely used mechanical differentiators. Enough gain to allow throwing it away with negative feedback to get linearity was a ways off in 1868.
- LolWolf 7y agoModern control theory (not counting RL, which is rarely, if ever, used on live controllers) is essentially two camps: PID with tuning and MPC (model predictive control). There is some optimal control theory not in either of these camps, but it’s not the norm. The latter is often studied under the umbrella of optimization theory (convex optimization mostly), but most aspects of it are well understood for most systems we care about (with some notable exceptions, of course). I wouldn’t quite say that “even control theory PhDs have trouble now” as there is plenty of work done on the field and many cases are quite useful (but they certainly have many topics to choose from for their theses!) :)