7 ms·
I don’t think the last one is right. Fully connected and CNN are part of “what neuron is connected to what neuron” (though in the case of CNN, a number of corre
by drdeca 2y ago
I don’t think the last one is right. Fully connected and CNN are part of “what neuron is connected to what neuron” (though in the case of CNN, a number of corresponding “neurons” have equal weights going to/from them ).
Also, “activation function” isn’t exactly the right thing for real biological neurons. They aren’t just functions of the current input or the like. Their behavior depends on their recent history. Some will like, by themselves iirc, periodically fire. Others will fire if enough input is sent within some amount of time (in some models of some of them there’s like, some accumulations of signal when receiving inputs, which gradually decays/leaks, and it fires (and depletes) if enough is accumulated).
But yes, the idea is that “what is connected to what” is obtained, but not more specific things about how the ones that are connected are connected (how the behavior of one relates to the behavior of the ones it is connected to).