3 ms·
Because you can still find the best gradient with ELU. Say you use sigmoid and you have big weights then your gradient can get stuck
by littlemtman 7y ago
Because you can still find the best gradient with ELU. Say you use sigmoid and you have big weights then your gradient can get stuck
- syntaxing 7y agoThanks for the answer! I also used Relu with no luck either. I figured Relu would work better than ELU but it didn't work for this application. Would you happen to know why ELU is superior to ReLU?
- littlemtman 7y agoRELU is really good for mostly positive weights. ELU is good for both