4 ms·
And then you learn about binary or ternary networks where gradients don’t really exist anywhere, and you start to wonder about the importance of this differenti
by p1esk 2y ago
And then you learn about binary or ternary networks where gradients don’t really exist anywhere, and you start to wonder about the importance of this differentiability.
- whimsicalism 2y agobinary networks don't really work well unless you do a relaxation first
- ubj 2y ago...And then you start learning about generalizations of the notion of "gradient" to scenarios where the classical gradient doesn't exist :)