4 ms·
You don’t have to do it manually. There is a database of file hashes. And this isn’t just “one engineer”. Companies like StabilityAI, Google, etc have used LAI
by vineyardmike 3y ago
You don’t have to do it manually. There is a database of file hashes.
And this isn’t just “one engineer”. Companies like StabilityAI, Google, etc have used LAION datasets. If you built a dataset you should expend some resources on automated filtering. Don’t include explicit imagery as an intentional choice if you can’t do basic filtering.