3 ms·
I think that this sort of forward backward thing is a very general idea. There’s a one to many relationship called the adjoint, and a many to one relationship c
by adamnemecek 6y ago
I think that this sort of forward backward thing is a very general idea. There’s a one to many relationship called the adjoint, and a many to one relationship called the norm.
I wrote something about this here https://github.com/adamnemecek/adjoint https://github.com/adamnemecek/adjoint
- tsmithe 6y agoIn fact, the compositional structure underlying that of predictive coding [0,1] is abstractly the same as that underlying backprop [2]. (Disclaimer: [0,1] are my own papers; I'm working on a more precise and extensive version of [1] right now!) [0] https://arxiv.org/abs/2006.01631 https://arxiv.org/abs/2006.01631 [1] https://arxiv.org/abs/2101.10483 https://arxiv.org/abs/2101.10483 [2] https://arxiv.org/abs/1711.10455 https://arxiv.org/abs/1711.10455
- eli_gottlieb 6y agoHurry and publish before I have manuscripts ready applying these results.
- tsmithe 6y agoHey, Eli :-) I'm working on it; I'll send you an e-mail. Things quickly turned out to be more general than I realized last year.
- eli_gottlieb 6y agoThat would make sense. The whole ACT/categorical cybernetics community has been working out how massively general optics are :-).
- selimthegrim 6y agoWhat were you going to say about Young tableaux?
- adamnemecek 6y agoDynamic programming and reinforcement learning are just diagonalizations of the Young tableau. This is related to the spectral theorem.
- selimthegrim 6y agoInteresting. Is there some concrete realization you had in mind?