5 ms·
You're wrong. See section 5.1. I've drawn a graph of it that shows it to be a classical NN with a single output node.
by jkabrg 9y ago
You're wrong. See section 5.1. I've drawn a graph of it that shows it to be a classical NN with a single output node.
- yorwba 9y agoYes, it is a classical NN with a single output node. I'm not disputing that, I just think their calculation of depth is strange. The network only applies the sigmoid function twice, and would ordinarily be regarded as having a depth of two. The third linear layer is fixed to multiplying by 1, which is what I meant by "has no effect". (Did you miss that I was talking about the third layer?)
- jkabrg 9y agoHere's a diagram [1] of a one-hidden-layer NN. It has 2 activation functions. Their NN is of the same type. [1] - https://raw.githubusercontent.com/qingkaikong/blog/master/40_ANN_part3_step_by_step_MLP/figures/figure4_hidden_perceptron.jpg https://raw.githubusercontent.com/qingkaikong/blog/master/40...
- yorwba 9y agoThe question is, how deep is that network?