4 ms·

> 73TB is a fair amount to have on a cloud From the article: "This was a bug in their crawler that was causing it to download the same files over and over aga

by xcv123 2y ago

> 73TB is a fair amount to have on a cloud From the article: "This was a bug in their crawler that was causing it to download the same files over and over again."

Joel_Mckay 2y ago
Must be a CDN choice issue, as most sites limit per IP daily file downloads, or have an account login with a quota limit. People hitting the same files again sounds like a developer testing their code.