2 ms·
>We've got a winner. Tensors "do" something; they're functions. And a neural network is just a stack of linear transforms (the "tensors") and nonlinear transfo
by joshuamorton 8y ago
>We've got a winner. Tensors "do" something; they're functions.
And a neural network is just a stack of linear transforms (the "tensors") and nonlinear transforms (the activations). So in a lot of cases, these "tensors" do do something. Granted the abstraction for storing the active tensors is also a great abstraction for storing high-dimensional data (like a 128x128x4x60 2-second video).
>neural networks as ODEs
You're a few months late :P [0]
[0]: https://arxiv.org/abs/1806.07366 https://arxiv.org/abs/1806.07366