2 ms·
Data pollution isn't the problem it is made out to be. You can even use a model trained on garbage data to relabel the original set and retrain. Google of all
by sitkack 3y ago
Data pollution isn't the problem it is made out to be. You can even use a model trained on garbage data to relabel the original set and retrain.
Google of all companies is sitting on exaflops of TPU capacity, they can retrain models larger than anyone else, faster than anyone else.
- visarga 3y agoI agree, but it would probably require to use LLMs to filter or augment the raw text. They can afford it.