4 ms·

According to this article [1], 500 hours of video are uploaded to YouTube every minute. Depending on the video size and framerate, YouTube recommends up to 240

According to this article [1], 500 hours of video are uploaded to YouTube every minute. Depending on the video size and framerate, YouTube recommends up to 240 Mbps for 8k@60FPS [2]. Of course most video isn't that high res. Let's take a conservative guess that it averages somewhere between 2K and 4K and pick a middle bitrate of 24 Mbps. That's: 24 Mbps / 8 bit/byte * 60 seconds/minute * 60 minute/hour = 10800 megabytes per hour of footage = 10.8 gigabytes per hour of footage At 500 hours of footage per minute, that means 5.4 terabytes are uploaded every minute. Your 720 TB array would be completely full a little over two hours' worth of content that is uploaded to YouTube every single day, day after day. At the current upload rate, 2,838.24 petabytes are uploaded every year. I don't think you'll see hobbyist archives of YouTube any time soon. [1]: https://www.tubefilter.com/2019/05/07/number-hours-video-uploaded-to-youtube-per-minute/ https://www.tubefilter.com/2019/05/07/number-hours-video-upl... [2]: https://support.google.com/youtube/answer/1722171?hl=en#zippy=%2Ccontainer-mp%2Cbitrate https://support.google.com/youtube/answer/1722171?hl=en#zipp...

yig 4y ago
I wonder how much of the uploaded content is public versus private or unlisted.
zacmps 4y ago
For archival 24Mbps is an insane bitrate, you could get away with 1/3th to 1/6th of that. You're also going to limit to public videos (unlisted and private will make up some share of those uploads) and probably to those with non-zero views. I suspect archiving only videos with >100 views would probably cut the amount you archive to 1/10th.
- Godel_unicode 4y ago
  This is a distinction without a difference, you’re still talking about O(1PB/day).
chiph 4y ago
Some back-of-the-envelope math shows that YouTube would have to populate and rack a minimum of four 4U storage chassis (60 20TB drives each) per 8 hour shift to store that much. Roughly a little less than half a 42U rack. And that's before allowing for HDD drive parity, redundancy, and distribution across the globe.
simongr3dal 4y ago
1080p webm is around 450kbps and audio is 65kbps, so the estimate is of by 50x for the purposes of a hobbyist archive.
- selfhoster11 4y ago
  YouTube offers a number of codecs and nitrates. IIRC Opus goes up to 160kbps and m4a goes up to 128kbps, with lower bitrates also available. I imagine video is similar.

yig 4y ago

I wonder how much of the uploaded content is public versus private or unlisted.

zacmps 4y ago

For archival 24Mbps is an insane bitrate, you could get away with 1/3th to 1/6th of that. You're also going to limit to public videos (unlisted and private will make up some share of those uploads) and probably to those with non-zero views. I suspect archiving only videos with >100 views would probably cut the amount you archive to 1/10th.

Godel_unicode 4y ago
This is a distinction without a difference, you’re still talking about O(1PB/day).

chiph 4y ago

Some back-of-the-envelope math shows that YouTube would have to populate and rack a minimum of four 4U storage chassis (60 20TB drives each) per 8 hour shift to store that much. Roughly a little less than half a 42U rack. And that's before allowing for HDD drive parity, redundancy, and distribution across the globe.

simongr3dal 4y ago

1080p webm is around 450kbps and audio is 65kbps, so the estimate is of by 50x for the purposes of a hobbyist archive.

selfhoster11 4y ago
YouTube offers a number of codecs and nitrates. IIRC Opus goes up to 160kbps and m4a goes up to 128kbps, with lower bitrates also available. I imagine video is similar.