4 ms·
I'd be interested, if any one had suggestions, on MPC applied to ML/AI systems -- it seems this is an underserved technique/concern in MLEng, and I'd expect to
by mjburgess 2y ago
I'd be interested, if any one had suggestions, on MPC applied to ML/AI systems -- it seems this is an underserved technique/concern in MLEng, and I'd expect to see more on it.
- lagrange77 2y agoThere is a big overlap between Optimal Control and Reinforcement Learning, in case you didn't know. Also Steve Brunton does a lot on the interface between control theory and ML on his channel: https://www.youtube.com/channel/UCm5mt-A4w61lknZ9lCsZtBw/playlists https://www.youtube.com/channel/UCm5mt-A4w61lknZ9lCsZtBw/pla...
- currymj 2y agothere's a lot of work in the broad area. most of it doesn't engage with the classical control theory literature (arguably it should). some keywords to search for recent hot research would be "world model", "decision transformer", "active inference", "control as inference", "model-based RL".
- szvsw 2y agoAnother thing to keep in mind is that having AI/ML surrogates which can evaluate expensive functions faster can also be integrated as an information source in model predictive control algorithms.
- lagrange77 2y agoExactly. ML models such as autoencoders can also be used for reduced order modeling / dimensionality reduction e.g. for MPC of fluid systems.