3 ms·
ReLu are mainly used because in practice they show better results than sigmoids in many areas. The fact that they are also faster to compute is just a nice side
by cmarschner 7y ago
ReLu are mainly used because in practice they show better results than sigmoids in many areas. The fact that they are also faster to compute is just a nice side effect.