2 ms·
Ok, but dot products and Fourier transforms are both linear operations. Maxwell's equations are linear (light also obeys them). Neural nets, on the other hand,
by amelius 2y ago
Ok, but dot products and Fourier transforms are both linear operations. Maxwell's equations are linear (light also obeys them).
Neural nets, on the other hand, generally require nonlinear operations. As do most computer programs.
So the explanation here is either not complete, or perhaps applies to a very restricted type of neural network only.
- CamperBob2 2y agoGood point. I know there are people working on optical NNs, but I have no idea how they handle nonlinear activation functions.
- Q6T46nT668w6i3m 2y agoThere’re a handful of ways to introduce electro-optical and all-optical non-linearities into optical neural networks. Here’s a fair survey of the field: https://dl.acm.org/doi/full/10.1145/3607533 https://dl.acm.org/doi/full/10.1145/3607533