Get a collection of data which is small enough to have humans annotate as being either low quality or high quality. Train a model to predict this annotation. Th

Get a collection of data which is small enough to have humans annotate as being either low quality or high quality. Train a model to predict this annotation. Then on a larger disjoint collection of data, use this model to estimate whether the data points would be considered low quality or high quality, and use this to filter it. This seems doable, and, I think something like it is already done?