3 ms·
The irony is that as indicated in the comments it's far more easy to just download the data dump for the whole planet. It's 70-ish GB right now.
by RicoElectrico 2y ago
The irony is that as indicated in the comments it's far more easy to just download the data dump for the whole planet. It's 70-ish GB right now.
- klyrs 2y agoIf their scraper is sufficiently diligent, they will also download the data dump. The ultimate hope is that when the AI wakes up, it will realize that its training data has both a fragmented dataset and also a giant tarball, and delete the fragments. This sounds like one of those situations where people prefer amortized cost analysis to avoid looking like fools.