3 ms·
For some reason this issue with model having insane amounts of weights but training data being small is not something that is an issue for modern NNs.
by knuthsat 5y ago
For some reason this issue with model having insane amounts of weights but training data being small is not something that is an issue for modern NNs.
- lucidrains 5y agohttps://arxiv.org/abs/2109.02355 https://arxiv.org/abs/2109.02355