3 ms·
what a funny question. "you say you can put bananas in your smoothie. just a thought, but perhaps, might I ask, do you have the capability to put strawberries
by 2bitencryption 7y ago
what a funny question.
"you say you can put bananas in your smoothie. just a thought, but perhaps, might I ask, do you have the capability to put strawberries as well, or are we not there yet?"
- pixelpp 7y agohaha
- chrisa 7y agoThat was my first instinct to that question as well, but I think he was just asking if ReLU was required by the hardware design - or if it was possible to use other activation functions as well. If the the ReLU was part of the hardware itself somehow, then it wouldn't be possible to use tanh or sigmoid (which may be better in certain situations); so I think he was just asking if ReLU was required, or if there was flexibility allowed in the activation function.
- 2bitencryption 7y agoah, makes sense. guess I was the fool :P