muppet_frog

5 ms·

1. 1.▲
   by muppet_frog 6y ago

   This paper makes the points that it's the saddles and not local minima that are the problem: https://arxiv.org/abs/1406.2572 It was the basis for adding 'momentum' to optimizers - so that you could skate
2. 2.▲
   by muppet_frog 6y ago

   ...hmm, that was counter to my understanding (limited though it may be...) which was partially formed by this paper: https://arxiv.org/abs/1712.09913 TLDR - loss landscapes are nasty, but you can tame them with skip co
3. 3.▲
   by muppet_frog 6y ago

   ...sounds like it costs much more than the $10 pi0... I imagine the OP's use case of IoT did not require huge amounts of bandwidth.
4. 4.▲
   by muppet_frog 7y ago

   Ahem...trebuchets are superior to catapults in every way.
5. 5.▲
   by muppet_frog 7y ago

   Not sure I would call a New York Times article 'clickbait'...