4 ms·
>Their x + sin(x) * 2 activation only really worked when the number of full cycles in the dataset was less than the number of paramters of the network, which co
by shreyshnaccount 4y ago
>Their x + sin(x) * 2 activation only really worked when the number of full cycles in the dataset was less than the number of paramters of the network, which completely misses the point. interesting, how did you come to this conclusion?
- lostmsu 4y agoIt is just a guess, that tries to explain the observed behavior.