4 ms·
You can actually do that. https://www.vincentsitzmann.com/siren/ https://www.vincentsitzmann.com/siren/
by PartiallyTyped 4y ago
You can actually do that.
https://www.vincentsitzmann.com/siren/ https://www.vincentsitzmann.com/siren/
- sicp-enjoyer 4y agoI'm surprised to see almost no discussion of fourier series in that paper, considering fourier series is all about representing signals as linear combinations of sinusoidal functions.
- PartiallyTyped 4y agoYou may be interested in [1] where they go to a great extend to show that the convolution operation that we consider in DL is the dual of fourier series [2]. [1] https://geometricdeeplearning.com https://geometricdeeplearning.com [2] https://arxiv.org/pdf/2104.13478.pdf https://arxiv.org/pdf/2104.13478.pdf page 27 (23 if you count book pages).
- amelius 4y agoIs convolution in DL not implemented with the FFT as the underlying workhorse?
- PartiallyTyped 4y agoProbably no since FFT is slower and less parallelizable than products.
- anoy8888 4y agoI like your article and went to your home page to find more good articles and I like what I saw. Thank you for sharing. The only thing is that I am reading from my phone and the site is not very mobile friendly