3 ms·
From the GitHub repo of the “dataset”: > [May 16, 2024 Update] Due to the recently added anti-bot measures by the data holders, our downloading pipeline is no
by codetrotter 2y ago
From the GitHub repo of the “dataset”:
> [May 16, 2024 Update] Due to the recently added anti-bot measures by the data holders, our downloading pipeline is no longer working. The video links are still accessible through a browser but not via our python crawler. We are working on a workaround and will make an update once we find one. At this time, we are still providing the parquet files to researchers, but researchers will need to find a way obtain the video data. Thank you for your understanding.
Ah, so on top of making a “dataset” of a category of specific works, they are also making people hammer the servers of other parties who never agreed to pay the bandwidth for a bunch of “researchers” wanting to download all of these files. Classy.