4 ms·
This is not a new algorithm. The same algorithm is described in Figure 4 (Theorem 3.1) of https://arxiv.org/pdf/2310.01655.pdf https://arxiv.org/pdf/2310.01655.
by SmartestUnknown 3y ago
This is not a new algorithm. The same algorithm is described in Figure 4 (Theorem 3.1) of https://arxiv.org/pdf/2310.01655.pdf https://arxiv.org/pdf/2310.01655.pdf
(Disclaimer: I am an author on the linked paper)
- smsx 3y agoThe point of this post isn’t the linear transformer algorithm. They’re surveying a variety of Linear transformers and showing a general form in order to talk at large about their performance characteristics.
- TTPrograms 3y agoI don't think the posted algorithm is particularly novel, but the algorithm you cite is deeply different. Also I note the only thing you have posted before is a link to this paper in particular.
- WeMoveOn 3y agohis username checks out
- SmartestUnknown 3y agoI didn't want to associate this account w/ my real name but now that you mentioned it wasn't right of me to not point that out. I added a disclaimer. The posted algorithm and the one mentioned in my paper are very similar. It is just that the cumulative sum computation is parallelized in the posted website.
- jakderrida 3y agoWell, that explains why the username looks like something either auto-generated or made up on the spot in under 10 seconds.