4 ms·
Probably off topic: it's the second time I am reading about phase shifts today. The first time I read it was in context of interpretability of attention in tran
by eulerian 3y ago
Probably off topic: it's the second time I am reading about phase shifts today. The first time I read it was in context of interpretability of attention in transformer neural nets where they find phase shifts between positional and semantic learning: https://arxiv.org/abs/2402.03902 https://arxiv.org/abs/2402.03902
- PaulHoule 3y agoIn my mind it is a geometric thing, that is, you find phases in things like oscillators that have the symmetry that the complex numbers do. (e.g. position and momentum for the oscillator rotate around the origin once in every cycle) This book https://maa.org/press/maa-reviews/the-geometry-of-biological-time https://maa.org/press/maa-reviews/the-geometry-of-biological... is one of the most profound on the subject, it is worth finding a used copy.
- AndrewKemendo 3y agoThis is very interesting! I think i might pick up a copy