3 ms·RELU is really good for mostly positive weights. ELU is good for bothby littlemtman 7y agoRELU is really good for mostly positive weights. ELU is good for both