5 ms·

I believe you forgot Toshiba, which could be 9 exabytes lost according to the article for this quarter, so we are talking about 15 exabytes lost. According to

by antpls 7y ago

I believe you forgot Toshiba, which could be 9 exabytes lost according to the article for this quarter, so we are talking about 15 exabytes lost. According to your data, the total quaterly production is 41 exabytes for SSD, which would mean losing about 37% of the total SSD production this quarter. That being said, it is the first time I read about the scale of storage production worldwide. It makes you wonder what does the humanity store in those hundreds of exabytes per year. Probably many duplicated data or unused bytes.

simcop2387 7y ago
These days a large portion of it is just basically logs. Logs of all the traffic we're generating looking at content on the internet, to be used to try to target ads. That and videos, youtube itself probably accounts for a significant amount of that storage use.
- owl57 7y ago
  Are the logs of this scale and less-popular videos usually stored on SSD? I thought HDDs are still cheaper and RAID gives enough throughput given enough disks?
  - dodobirdlord 7y ago
    Logs are probably on HDD, video might be on SSD given how aggressively it gets edge-cached.
  - londons_explore 7y ago
    HDD's access time (10milliseconds or more), means a hard disk can't really serve more than 100 concurrent users, assuming each wants to stream a chunk of video every second. That makes it a poor choice for serving anything but the rarest of YouTube videos.
    - owl57 7y ago
      I believe a typical video, stored in all of the Youtube formats, uses on the order of a megabyte per second. So, a 10TB disk probably holds about 100 days of video. Seems fine for videos that are watched less than once a day, that's probably a vast majority of Youtube's storage.
jsjohnst 7y ago
> It makes you wonder what does the humanity store in those hundreds of exabytes per year. Let’s as a hypothetical assume that Apple iPhones average 128GB of storage in 2019 (they go up to 512gb after all now). Let’s also assume Apple sells 50M iPhones in 2019. Doing the math, assuming my wild estimates are right, that gives us about 6.4 exabytes of storage usage in 2019 for just iPhones alone. Android however ships something like 1.25B devices per year. The storage average is way lower I’d assume, but that’s still easily in the tens of exabytes per year most likely.

by antpls 7y ago

simcop2387 7y ago

These days a large portion of it is just basically logs. Logs of all the traffic we're generating looking at content on the internet, to be used to try to target ads. That and videos, youtube itself probably accounts for a significant amount of that storage use.

owl57 7y ago
Are the logs of this scale and less-popular videos usually stored on SSD? I thought HDDs are still cheaper and RAID gives enough throughput given enough disks?
- dodobirdlord 7y ago
  Logs are probably on HDD, video might be on SSD given how aggressively it gets edge-cached.
- londons_explore 7y ago
  HDD's access time (10milliseconds or more), means a hard disk can't really serve more than 100 concurrent users, assuming each wants to stream a chunk of video every second. That makes it a poor choice for serving anything but the rarest of YouTube videos.
  - owl57 7y ago
    I believe a typical video, stored in all of the Youtube formats, uses on the order of a megabyte per second. So, a 10TB disk probably holds about 100 days of video. Seems fine for videos that are watched less than once a day, that's probably a vast majority of Youtube's storage.

jsjohnst 7y ago

> It makes you wonder what does the humanity store in those hundreds of exabytes per year. Let’s as a hypothetical assume that Apple iPhones average 128GB of storage in 2019 (they go up to 512gb after all now). Let’s also assume Apple sells 50M iPhones in 2019. Doing the math, assuming my wild estimates are right, that gives us about 6.4 exabytes of storage usage in 2019 for just iPhones alone. Android however ships something like 1.25B devices per year. The storage average is way lower I’d assume, but that’s still easily in the tens of exabytes per year most likely.