Sure, you can modify your model to better account for bad training data. But you could also fix the training data. The previous comment pointed out that fixing

Sure, you can modify your model to better account for bad training data. But you could also fix the training data. The previous comment pointed out that fixing the training data (to a high degree at least, using the predictions of an intermediate version) is significantly faster than the initial labeling.