5 ms·

Isn't this essentially looking for a fixpoint?

• vanderZwan 9y ago
  > In mathematics, a fixed point (sometimes shortened to fixpoint, also known as an invariant point) of a function is an element of the function's domain that is mapped to itself by the function. https://en.wikipedia.org/wiki/Fixed_point_(mathematics) https://en.wikipedia.org/wiki/Fixed_point_(mathematics) Looks like it. And they need to resort to some mathematical trickery to achieve this because as the explain in the paper: > A neural network is parametrized by a set of parameters Θ, and our goal is to build a network that outputs Θ itself. This is difficult to do directly. Suppose the last layer of a feed-forward network has A inputs and B outputs. Already, the size of the weight matrix in a linear transformation is the product AB which is greater than B for any A > 1.