I am not an expert in this field. From what I currently understand in the CNN/deep learning arena, sigmoids are avoided in favor of RELU, due to a number of re

I am not an expert in this field. From what I currently understand in the CNN/deep learning arena, sigmoids are avoided in favor of RELU, due to a number of reasons, chiefly that of avoiding gradient fade during backprop. I'm surprised that you don't mention this (or don't seem to be aware of it), though? Is this intentional, or is there another reason?