3 ms·
How hard would it be to find random networks that don't need to be trained at all?
by optimalsolver 5y ago
How hard would it be to find random networks that don't need to be trained at all?
- AnIdiotOnTheNet 5y agoDepends on the size of the network I would guess. A Boltzmann brain would apparently take about 10^10^50 years to form from quantum fluctuation in a vacuum. Our hypothetical neural network would be less complicated than that, assuming we're not aiming for general AI, so I think we can safely take that as an upper bound...
- CaptainNegative 5y agoWith a uniform initialization, presumably you'd never need much more than 2^(network bit complexity) number of samples to come across an ideally-initialized network with decent probability, so that's 2^10^24 for anything that fits in a yottabyte.
- freemint 5y agoIn the absence of dynamics and uniform random mutation, yes. But Both don't hold in the universe.
- belgian_guy 5y agoSurprisingly, it's quite doable in practice. See e.g. https://arxiv.org/abs/1911.13299 https://arxiv.org/abs/1911.13299.