4 ms·
> Fully connected neural networks are hierarchies of logistic regression nodes. Only if you use softmax ss your activation function.
by thomasahle 3y ago
> Fully connected neural networks are hierarchies of logistic regression nodes.
Only if you use softmax ss your activation function.
- bjornsing 3y agoYou mean sigmoid activation function?
- thomasahle 3y agoIf we are talking about "hierarchies of logistic regression nodes" we have to define how to extend logistic regression to multiple outputs. The most common approach is Multinomial logistic regression: https://en.wikipedia.org/wiki/Logistic_regression#Extensions https://en.wikipedia.org/wiki/Logistic_regression#Extensions . Other times sigmoid might be the right answer.