4 ms·
Neural networks operate on floating point values. Are you saying that e.g. 64 bits of resolution isn't enough to accurately model a neuron? The idea of signific
by mpoteat 4y ago
Neural networks operate on floating point values. Are you saying that e.g. 64 bits of resolution isn't enough to accurately model a neuron? The idea of significant figures in physics puts a limit on what is useful in practice.
I could be wrong, but I feel that digital vs analog is a pretty meaningless distinction in this case, as past a certain level of resolution in practice this is noise.
This doesn't even get into the fact that we know the universe is quantum in nature and that systems have a finite amount of possible states. The universe does not have a "infinite" state resolution in the way you are talking about, merely a large one.