5 ms·
I was expecting to find out how much data YouTube has, but that number wasn't present. I've used the stats to roughly calculate that the average video is 500 se
by drewtato 3y ago
I was expecting to find out how much data YouTube has, but that number wasn't present. I've used the stats to roughly calculate that the average video is 500 seconds long. Then using a bitrate of 400 KB/s and 13 billion videos, that gives us 2.7 exabytes.
I got 400KB/s from some FHD 24-30 fps videos I downloaded, but this is very approximate. YouTube will encode sections containing less perceptible information with less bitrate, and of course, videos come in all kinds of different resolutions and frame rates, with the distribution changing over the history of the site. If we assume every video is 4K with a bitrate of 1.5MB/s, that's 10 exabytes.
This estimate is low for the amount of storage YouTube needs, since it would store popular videos in multiple datacenters, in both VP9 and AV1. It's possible YouTube compresses unpopular videos or transcodes them on-demand from some other format, which would make this estimate high, but I doubt it.
- staplers 3y agoI'm interested in the carbon footprint.
- mattlondon 3y agohttps://sustainability.google/operating-sustainably/net-zero-carbon/ https://sustainability.google/operating-sustainably/net-zero...
- staplers 3y agoThanks, 10 million metric tons per year. ~0.1% of global emissions. Pretty wild stuff.
- laluser 3y agoYou’re forgetting about replication and erasure coding overhead. 10 exabytes seems very low tbh. I’d put it closer to 50-100EB at this point.
- ksec 3y agoThat storage number is highly likely to be off by an order of magnitude. 400KB/s, or 3.2Mbps as we would commonly use in video encoding, is quite low for original quality upload in FHD or commonly known as 1080p. The 4K video number is just about right for average original upload. You then have to take into account YouTube at least compress those into 2 video codec, H.264 and VP9. Each codec to have all the resolution from 320P to 1080P or higher depending on the original upload quality. With many popular additional and 4K video also encoded in AV1 as well. Some even comes in HEVC for 360 surround video. Yes you read that right. H.265 HEVC on YouTube. And all of that doesn't even include replication or redundancy. I would not be surprised if the total easily exceed 100EB. Which is 100 (2020 ) Dropbox in size.
- 38 3y ago> The 4K video number is just about right for average original upload. No, it definitely is not.
- the-rc 3y agoOn one hand: just two formats? There are more, e.g. H264. And there can be multiple resolutions. On the same hand: there might be or might have been contractual obligations to always deliver certain resolutions in certain formats. On the other hand: there might be a lot of videos with ridiculously low view counts. On the third hand: remember that YouTube had to come up with their own transcoding chips. As they say, it's complicated. Source: a decade ago, I knew the answer to your question and helped the people in charge of the storage bring costs down. (I found out just the other day that one of them, R.L., died this February... RIP)
- drewtato 3y agoFor resolutions over 1080, it's only VP9 (and I guess AV1 for some videos), at least from the user perspective. 1080 and lower have H264, though. And I don't think the resolutions below 1080 are enough to matter for the estimate. They should affect it by less than 2x. The lots of videos with low view counts are accounted for by the article. It sounds like the only ones not included are private videos, which are probably not that numerous.
- charcircuit 3y agoKeep in mind youtube permanently keeps a copy of the original upload which may have an even larger file size
- qingcharles 3y agoDo you know that for certain? I always suspected they would, so they could transcode to better formats in the future, but never found anything to confirm it.
- charcircuit 3y agoI know it was true at least a couple of years ago, but there is no guarantee that they keep it.
- edent 3y agoOn all of the videos I have uploaded to my YouTube channel, I have a "Download original" option. That stretches back a decade. Granted, none of them are uncompressed 4K terabyte sized files. I haven't got my originals to do a bit-for-bit comparison. But judging by the filesizes and metadata, they are all the originals.
- eek2121 3y ago[flagged]
- virtuallynathan 3y agoI did the math on this back in 2013, based on the annual reported number of hours uploaded per minute, and came up with 375PB of content, adding 185TB/day, with a 70% annual growth rate. This does not take into account storing multiple encodes or the originals.