6 ms·
Observability: A New Theory Based on the Group of Invariance
- choeger 5y agoCould someone here enlighten me what a nonlinear system in this context is, or rather what it is not? What I mean is: If I give you an arbitrary black box that computes outputs based on inputs I could make it arbitrarily hard to find any relationship whatsoever between input and output. Say I take the input, an internal hidden variable of some kilobytes and return some hash of the two. There's (nearly) certainly no way to learn anything meaningful about my internal variable by just observing input and output. So what's the limitation in the context of this paper? Differentiable functions?
- doppioandante 5y agoThe term nonlinear system here must be understood from the point of view of control engineering. In control theory, a system is usually described in a white-box manner by a differential equation and an observation equation: dx/dt = f(x, u, t) y = h(x, u, t) x is a vector of the so called state-variables, while y is the output vectors which usually represents what we can measure about the system, u is a function which represents the inputs to the system, and t is the time. A very useful and simple modeling tool is that of linear time-invariant systems (LTI), where the above equations are specifically dx/dt = Ax+Bu y = Cx+Du where (A,B,C,D) are matrices. Every bit of theory is known about LTI systems: how to control them, global properties, etc. Nonlinear systems are, loosely speaking, dynamical systems which are not linear in the above sense. Depending on the specific nonlinear system form, much less can be said than the linear system case.
- choeger 5y agoThanks. So we are talking about ODE in state-space form, right? So in my example, if x was a (largish) time constant integer (f(x,u,t) = 0) and the observation function was h(x,u,t) = sha256sum(x,u) What could a control theorist tell about that (nonlinear) system?
- 317070 5y agosha256sum is not a continuous function. These functions should be continuous. Usually there are light restrictions on these functions to avoid what you are trying to do. Lyapunov bounded, C2 continuous, ... Control engineers could use a piecewise approximation of an observer or controller, or use non-linear methods (like reinforcement learning, model predictive control, LQR, ...)
- choeger 5y agoThanks. That makes a lot of sense, indeed.
- dataflow 5y ago...nothing? Why makes you think they should be able to say anything? I'm so perplexed by your question... you seem already quite familiar with ordinary differential equations and state-space models... which are concerned with the observability of continuous-time models, right? And yet you pose a counterexample using a cryptographic hash function, which is a (very!) discrete function, and one that is specifically designed to be unobservable? Isn't that even more jarring than asking physicists to predict human life expectancy from the Standard Model? What makes you think the answer might be anything other than "no prediction"...?
- choeger 5y agoI did not expect a positive answer here. I wanted to know what the implicit constraints are so I chose an example that was obviously impossible. I worked across domains for a while (CS, simulation, mathematics) and one thing that was really problematic was that people from one domain used a lot of implicit constraints that the other partners weren't aware of. This then led to incorrect software and weird simulation results.
- spenczar5 5y agoSometimes someone asks a question in earnest. They really don’t know, and want to know more. They aren’t trying to score points or win a debate or strike a rhetorical victory. I had just the same question as the commenter. I just don’t know much about this topic, and think that this question and its answers really helped my understanding.
- justincormack 5y agoSibling comment is very helpful in terms of what linear is. In terms of the abstract, your system isn't "observable" as even with all the inputs and outputs in a given time period, and knowledge of the hash functions, you still won't be able to work out the internal state. If you had all the inputs since it started you could (assuming it was deterministic and so on) but thats "less observable" in some sense as you need potentially unbounded information. While linear systems are tractable, some nonlinear systems could be tractable too. Software is interesting from this point of view as while its clearly nonlinear, we can create mechanisms to expose otherwise hidden internal state and to control it, although there is generally such a large number of internal states that this is difficult.
- tkluck 5y agoThe abstract has strong https://xkcd.com/793 https://xkcd.com/793 vibes.
- jamessb 5y agoI don't really agree - the xkcd cartoon is about physicists naively going from real-world phenomena to mathematical models, without understanding what is important or already known about the problem domain. In his case, a physicist is looking at a problem that already has a standard mathematical formalism in control theory, and is suggesting new theoretical approaches to apply to it that he claims provides additional insights. And, whereas in the cartoon the physicist says, "why does <your field> need a whole journal, anyway", the author of this monograph publishes in existing control theory journals (e.g., [1] in IEEE Transactions on Automatic Control). [1]: https://dx.doi.org/10.1109/TAC.2018.2798806 https://dx.doi.org/10.1109/TAC.2018.2798806
- tkluck 5y agoFair enough, I was shooting from the hip a bit. I made the remark based on "Its natural audience would be control theorists, but they may find the level of abstraction very challenging" which sounds a bit condescending even if true.
- gnramires 5y agoAgreed, but note (afaik) group theory is not usually applied in Control Theory, so it does seem it would be a challenge to someone in the field (maybe just a helpful disclaimer).
- doppioandante 5y agoFrom a quick skim, it certainly looks like advanced mathematics is at use, but control theorists that deal with nonlinear systems have been using this kind of formalism already. Lie groups are even used in robotics to write down kinematics of serial chains.
- teleforce 5y agoOne of the key publications related to the book, "Nonlinear Unknown Input Observability: Extension of the Observability Rank Condition" (IEEE paywall): https://ieeexplore.ieee.org/document/8270358 https://ieeexplore.ieee.org/document/8270358
- jvanderbot 5y agoLie groups were well understood for estimation problems, which also are very concerned with observability. In fact, applying standard control theory 'through' an observable system is no giant achievement. In 2010-2015 a hit topic was 'consistency' which was shown to be related to observability by using something that seems to be quite similar (based on keyword matching alone). Roumeliotis and Gao did a lot of work here. It's old news. I'm surprised it didn't translate back to control theory, but it probably did. The writing of the abstract actually treats observability in that context, with monocular cameras on drones and all that. And it wouldn't suprise me if there was a little bit of XKCD factor going on. https://xkcd.com/793 https://xkcd.com/793. I mean, 'developed by the author' might be a bit strong. But I haven't read the article yet so those are first impressions.
- goldbattle 5y agoMy understanding is is that group invariance is just another perspective to look at the original non-linear system transformations as compared to the more traditional "on-manifold". Really it seems like an easier way to derive a system which the observable properties of the system are well defined as compared to worrying about ensuring observability (and unobservability) properties hold through the non-linear linearization process. There are quite a few groups that use "invariant filters" in robotics (eg [1]), but I always wonder if this could not be addressed through more traditional means (i.e. designing a better state representations or correcting gains in unobservable directions). Roumeliotis is referring to Stergios [2] or another scholar? Could you provide full names? [1] https://arxiv.org/abs/1805.10410 https://arxiv.org/abs/1805.10410 [2] https://scholar.google.com/citations?user=c5HeXxsAAAAJ&hl=en&oi=sra https://scholar.google.com/citations?user=c5HeXxsAAAAJ&hl=en...
- antegamisou 5y agoI wonder how do the people here upvote stuff. Considering that probably the entire HN community has never even heard about control theory before, let alone have the background to understand the abstract of the book, how did this submission receive almost 100 points? Do fancy-looking titles get the most attention? Same with any math-heavy submission. Do the submitters really expect the average DevOps person, which probably makes up something like 90% of HN, be able to understand and comment on such advanced subjects? These are legitimate questions and by no means do I intend to foster a gatekeeping mentality.
- ggerules 5y agoI'm interested and understand the topic. Also, I'm interested in many mathematical topics.
- antegamisou 5y agoSo apparently you’re a math PhD. How many times have you came across somebody with your background here? Consider that the audience here is mostly tech-literate, not STEM wizards. Which is why it’s baffling seeing exotic math words on the frontpage.
- sdenton4 5y agoIt really only takes a couple-few math wizards seeing a thing to vote it onto the front page for a bit, where other math wizards have a good chance of seeing it and upvoting it further. Notice that 100 upvotes only requires 100 wizards amongst the HN population. I also agree with others that the assumptions about 'mostly devops' may well be very wrong. Control theory should be at least somewhat familiar to anyone who's worked in robotics and/or aviation, as well. A whoooole lot of people dabble in robotics during undergrad, and many older software engineers get into drones (like the author of the monograph!) or flying.
- igorkraw 5y agoYou are making heavy assumptions on the composition and math literacy of the HN community, the idea of people not upvoting things they don't fully understand and the difficulty of control theory. I've had this stuff in uni, forgot most of it, and re-learned it during my current studies via thinking about optimization of neural networks and I think both our understanding of things and pedagogy are improving to the point that it's not unreasonable to expect tech-interested recent high school grads to have an intuition, if not a formal understanding of control theory. 3B1B might be the most "to blame" for this, but also just the proliferation of tutorials, making etc. PID controllers are not very complicated, people dig into robotics on their own and find PID might not be enough => voila, they self teach observability, controllability, lie algebras etc.
- nil-sec 5y agoI have no background in control theory but this sounds very similar to the identifiability problem in nonlinear ICA. Are those equivalent?
- deleted 5y ago[deleted]