3 ms·
It’s an interesting thought experiment to consider models that have more parameters than there are data points being analyzed. What does that mean?
by mensetmanusman 6y ago
It’s an interesting thought experiment to consider models that have more parameters than there are data points being analyzed.
What does that mean?
- rdlecler1 6y agoAll networks are like this. In a network of N nodes you have N^2 potential relationships. That’s just simple paired relationships. You can still go to higher order groups.
- igorkraw 6y agoIt basically means you need to learn about double descent: https://twitter.com/hippopedoid/status/1243229024085835779 https://twitter.com/hippopedoid/status/1243229024085835779 and regularize your models well, implicitly or explicitly. Your model might otherwise memorize the data instead of learning features.