4 ms·
I'm surprised to see almost no discussion of fourier series in that paper, considering fourier series is all about representing signals as linear combinations o
by sicp-enjoyer 4y ago
I'm surprised to see almost no discussion of fourier series in that paper, considering fourier series is all about representing signals as linear combinations of sinusoidal functions.
- PartiallyTyped 4y agoYou may be interested in [1] where they go to a great extend to show that the convolution operation that we consider in DL is the dual of fourier series [2]. [1] https://geometricdeeplearning.com https://geometricdeeplearning.com [2] https://arxiv.org/pdf/2104.13478.pdf https://arxiv.org/pdf/2104.13478.pdf page 27 (23 if you count book pages).
- amelius 4y agoIs convolution in DL not implemented with the FFT as the underlying workhorse?
- PartiallyTyped 4y agoProbably no since FFT is slower and less parallelizable than products.
- anoy8888 4y agoI like your article and went to your home page to find more good articles and I like what I saw. Thank you for sharing. The only thing is that I am reading from my phone and the site is not very mobile friendly