3 ms·
Computing power, but also some implementation tricks that turn out to make things a lot better. For example, activation via ReLU instead of sigmoid/tanh signif
by gcp 10y ago
Computing power, but also some implementation tricks that turn out to make things a lot better.
For example, activation via ReLU instead of sigmoid/tanh significantly improves the performance of deep neural networks.
Then there's stuff like BatchNorm, Pooling, Dropout etc...