4 ms·

Over-generalizing means that you will compress worse, as does under-generalizing. Can't use the mere fact that "compression is going on", you have to look into

Over-generalizing means that you will compress worse, as does under-generalizing. Can't use the mere fact that "compression is going on", you have to look into utility, costs, etc.

jacobush 6y ago
How? "All X people behave in Y ways" is an over-generalization and seems to compress very well.
- murbard2 6y ago
  You need to encode the delta between your model and what you observe, and that delta will be expensive to encode if your model over-generalizes.
  - jacobush 6y ago
    Thanks, your comment made understand a tiny little bit more of the machine learning lingo. I think. :-D