5 ms·

Great. I have another form of mathematics that I need to learn. I'll put it on the pile on top of geometrical algebra and stochastic processes.

edwintorok 10y ago
FWIW my first encounter with a Bayesian explanation of Kalman filters was this series: https://github.com/rlabbe/Kalman-and-Bayesian-Filters-in-Python https://github.com/rlabbe/Kalman-and-Bayesian-Filters-in-Pyt...
astine 10y ago
Sometimes I wish I could quit my job for a few years and just catch up on all of the math I'd like to know. There is an amazing amount of stuff to learn that I just have no clue about and ultimately is much more interesting than yet another HR tool.
- moron4hire 10y ago
  My advice is to just start a side programming project where you have to learn the concept. I think it's a much, much faster way of learning, to have to implement the technique, than to go through textbooks and exercises. I don't think most people who aren't career mathematicians will truly understand linear algebra until they write a few Matrix and Vector libraries in support of some other thing they are deeply interested in building.
  - cossatot 10y ago
    Seconded. The slightly better option, if you can get away with it, is working it into a project at work (rather than a side project) so you can devote a few of your fresh-brained 9-5 hours to it each week and not feel too guilty.
- sn9 10y ago
  You could just work for a couple hours per day on it, or 10-20 hours per week on it. Smaller opportunity cost missed and more likely to complete the goal than just taking a sabbatical.
  - exDM69 10y ago
    I've done this, learning advanced orbital mechanics on my spare time. But I manage to put in 1-3 hours a week, about one week per month at most and it's been almost half a year since the last time I was able to put my mind into it. It's not like I don't have the time, it's the fact that I'm way too tired after work to do any substantial amount of learning. I think I could manage something that's much easier, say learning some languages or learning how to knit. But learning math, physics, etc just requires more than I have to give after work. That said, I managed to get a firm understanding of orbital mechanics up to a level where I could probably ace all the tests for freshman-level courses at an aerospace university and I did all of it on Saturday afternoons (but it took me 5 years to do so).
    - jahabrewer 10y ago
      > I've done this, learning advanced orbital mechanics on my spare time. Sooo...... you play KSP? ;)
      - exDM69 10y ago
        Yes, I play KSP and Orbiter. In my study project, I learned thoroughly how to solve different two body problems (initial value, boundary value, closest approach) and wrote a C library [0] that's got all the orbital mechanics code you need to write your own Kerbal Space Program clone (but I don't intend to do that). During the process, I read 3-4 books and an inch thick pile of research papers. [0] https://github.com/rikusalminen/twobody https://github.com/rikusalminen/twobody
        antognini 10y ago
        If you'd like to start looking at three-body problems, you might be interested in studying the Kozai-Lidov mechanism. It's a really fascinating subject, so much so that I did my dissertation on it! Here's a really good paper (one of my all time favorites) to get you started: https://arxiv.org/abs/1309.5244 https://arxiv.org/abs/1309.5244
    - 10y ago
tnecniv 10y ago
Kalman filters (unless you get into really esoteric modifications) are just one tool and are related to stochastic processes. It's more like learning an algorithm than learning a whole field of math.
- surement 10y ago
  Also, the wikipedia article for it is possibly the best-written math article I've read: https://en.wikipedia.org/wiki/Kalman_filter https://en.wikipedia.org/wiki/Kalman_filter
platz 10y ago
-- Kalman Filters vs HMM (Hidden Markov Model): "In both models, there's an unobserved state that changes over time according to relatively simple rules, and you get indirect information about that state every so often. In Kalman filters, you assume the unobserved state is Gaussian-ish and it moves continuously according to linear-ish dynamics (depending on which flavor of Kalman filter is being used). In HMMs, you assume the hidden state is one of a few classes, and the movement among these states uses a discrete Markov chain. In my experience, the algorithms are often pretty different for these two cases, but the underlying idea is very similar." - THISISDAVE -- HMM vs LSTM/RNN: "Some state-of-the-art industrial speech recognition [0] is transitioning from HMM-DNN systems to "CTC" (connectionist temporal classification), i.e., basically LSTMs. Kaldi is working on "nnet3" which moves to CTC, as well. Speech was one of the places where HMMs were _huge_, so that's kind of a big deal." -PRACCU "HMMs are only a small subset of generative models that offers quite little expressiveness in exchange for efficient learning and inference." - NEXTOS "IMO, anything that be done with an HMM can now be done with an RNN. The only advantage that an HMM might have is that training it might be faster using cheaper computational resources. But if you have the $$$ to get yourself a GPU or two, this computational advantage disappears for HMMs." - SHERJILOZAIR
- TheArcane 10y ago
  Sweet. What are the names you mentioned in capital after the quotes? Are they HN usernames?

edwintorok 10y ago

FWIW my first encounter with a Bayesian explanation of Kalman filters was this series: https://github.com/rlabbe/Kalman-and-Bayesian-Filters-in-Python https://github.com/rlabbe/Kalman-and-Bayesian-Filters-in-Pyt...

astine 10y ago

Sometimes I wish I could quit my job for a few years and just catch up on all of the math I'd like to know. There is an amazing amount of stuff to learn that I just have no clue about and ultimately is much more interesting than yet another HR tool.

moron4hire 10y ago
My advice is to just start a side programming project where you have to learn the concept. I think it's a much, much faster way of learning, to have to implement the technique, than to go through textbooks and exercises. I don't think most people who aren't career mathematicians will truly understand linear algebra until they write a few Matrix and Vector libraries in support of some other thing they are deeply interested in building.
- cossatot 10y ago
  Seconded. The slightly better option, if you can get away with it, is working it into a project at work (rather than a side project) so you can devote a few of your fresh-brained 9-5 hours to it each week and not feel too guilty.
sn9 10y ago
You could just work for a couple hours per day on it, or 10-20 hours per week on it. Smaller opportunity cost missed and more likely to complete the goal than just taking a sabbatical.
- exDM69 10y ago
  I've done this, learning advanced orbital mechanics on my spare time. But I manage to put in 1-3 hours a week, about one week per month at most and it's been almost half a year since the last time I was able to put my mind into it. It's not like I don't have the time, it's the fact that I'm way too tired after work to do any substantial amount of learning. I think I could manage something that's much easier, say learning some languages or learning how to knit. But learning math, physics, etc just requires more than I have to give after work. That said, I managed to get a firm understanding of orbital mechanics up to a level where I could probably ace all the tests for freshman-level courses at an aerospace university and I did all of it on Saturday afternoons (but it took me 5 years to do so).
  - jahabrewer 10y ago
    > I've done this, learning advanced orbital mechanics on my spare time. Sooo...... you play KSP? ;)
    - exDM69 10y ago
      Yes, I play KSP and Orbiter. In my study project, I learned thoroughly how to solve different two body problems (initial value, boundary value, closest approach) and wrote a C library [0] that's got all the orbital mechanics code you need to write your own Kerbal Space Program clone (but I don't intend to do that). During the process, I read 3-4 books and an inch thick pile of research papers. [0] https://github.com/rikusalminen/twobody https://github.com/rikusalminen/twobody
      - antognini 10y ago
        If you'd like to start looking at three-body problems, you might be interested in studying the Kozai-Lidov mechanism. It's a really fascinating subject, so much so that I did my dissertation on it! Here's a really good paper (one of my all time favorites) to get you started: https://arxiv.org/abs/1309.5244 https://arxiv.org/abs/1309.5244
  - 10y ago

tnecniv 10y ago

Kalman filters (unless you get into really esoteric modifications) are just one tool and are related to stochastic processes. It's more like learning an algorithm than learning a whole field of math.

surement 10y ago
Also, the wikipedia article for it is possibly the best-written math article I've read: https://en.wikipedia.org/wiki/Kalman_filter https://en.wikipedia.org/wiki/Kalman_filter

platz 10y ago

-- Kalman Filters vs HMM (Hidden Markov Model): "In both models, there's an unobserved state that changes over time according to relatively simple rules, and you get indirect information about that state every so often. In Kalman filters, you assume the unobserved state is Gaussian-ish and it moves continuously according to linear-ish dynamics (depending on which flavor of Kalman filter is being used). In HMMs, you assume the hidden state is one of a few classes, and the movement among these states uses a discrete Markov chain. In my experience, the algorithms are often pretty different for these two cases, but the underlying idea is very similar." - THISISDAVE -- HMM vs LSTM/RNN: "Some state-of-the-art industrial speech recognition [0] is transitioning from HMM-DNN systems to "CTC" (connectionist temporal classification), i.e., basically LSTMs. Kaldi is working on "nnet3" which moves to CTC, as well. Speech was one of the places where HMMs were _huge_, so that's kind of a big deal." -PRACCU "HMMs are only a small subset of generative models that offers quite little expressiveness in exchange for efficient learning and inference." - NEXTOS "IMO, anything that be done with an HMM can now be done with an RNN. The only advantage that an HMM might have is that training it might be faster using cheaper computational resources. But if you have the $$$ to get yourself a GPU or two, this computational advantage disappears for HMMs." - SHERJILOZAIR

TheArcane 10y ago
Sweet. What are the names you mentioned in capital after the quotes? Are they HN usernames?