6 ms·

> 55 TB ... > smallish What a time to be alive

by biggc 6y ago

wongarsu 6y ago
55 TB fits comfortably on 4 16TB HDDs. You can fit around 8 drives in a single tabletop NAS before you have to go either to multiple enclosures or rack mounting. Using that as a metric I would call anything below 100TB smallish. Storage is indeed progressing a lot.
- generalizations 6y ago
  That much storage would still cost somewhere around $1500-$2000. Impressively low, but still in the range of a very dedicated hobbyist.
  - agumonkey 6y ago
    Clearly .. tons of people spend more than that on gears of way less value (think GPUs for leisure purposes only). Have a tiny online donation setup and you could get full sponsorship or half easily.
    - vbezhenar 6y ago
      I think that kind of donation exposure would open you to some legal risks. Now you're some kind of visible commercial entity, not just some random IP address in the tracker response.
      - agumonkey 6y ago
        These days people do fundraising for all sorts of reason and get money. One could always invent a good story to avoid explaining the real reason behind the gears.
- Pixionus 6y ago
  For most of the lay users I help in the community 4tb is immense. For most of my colleagues (I work on Kubernetes cluster backbends for large companies running streaming services you likely use, among other 'big' data companies) 20-50tb is if you run your own all time backups (usually with ZFS and the like so divide that by 3 for total usable space). The guys that are running IPtv or other sketchy video streaming and scraping software are hovering around 100TB-200TB in their NAS and none of them actually run user grade hardware... I'm honestly very surprised to hear it referred to as 'smallish'.. At most I'd say 100TB is about middle of the road now days for media horders and small for media content producers. Now my buddy that worked on the CEPH storage backed at CERN would laugh at any of these numbers... but that's a different ballpark all together..
- pmiller2 6y ago
  You can get more than 8 without going to external enclosures. I have a tower case with 15 drive bays in it.
- dzhiurgis 6y ago
  There are 30/50/100 TB SSD’s that would fit your coat pocket
- snvzz 6y ago
  There's progress indeed, but 4x 16TB isn't cutting it. You'd need extra disks for redundancy, extra space for filesystem overhead (including data and metadata checksums), and a sizable amount of ECC memory.
  - vbezhenar 6y ago
    You don't strictly need ECC memory for that specific task. Torrents have checksums for every file chunk, so even if some bit corrupted because of RAM, it's enough to re-check the files and re-download corrupted pieces if needed. That said, complete re-check of 64 TB at 250 MB/s would take at least 71 hour. So ECC RAM definitely won't hurt.

> 55 TB ... > smallish What a time to be alive

by biggc 6y ago

> 55 TB ... > smallish What a time to be alive

55 TB fits comfortably on 4 16TB HDDs. You can fit around 8 drives in a single tabletop NAS before you have to go either to multiple enclosures or rack mounting. Using that as a metric I would call anything below 100TB smallish. Storage is indeed progressing a lot.

generalizations 6y ago
That much storage would still cost somewhere around $1500-$2000. Impressively low, but still in the range of a very dedicated hobbyist.
- agumonkey 6y ago
  Clearly .. tons of people spend more than that on gears of way less value (think GPUs for leisure purposes only). Have a tiny online donation setup and you could get full sponsorship or half easily.
  - vbezhenar 6y ago
    I think that kind of donation exposure would open you to some legal risks. Now you're some kind of visible commercial entity, not just some random IP address in the tracker response.
    - agumonkey 6y ago
      These days people do fundraising for all sorts of reason and get money. One could always invent a good story to avoid explaining the real reason behind the gears.
Pixionus 6y ago
For most of the lay users I help in the community 4tb is immense. For most of my colleagues (I work on Kubernetes cluster backbends for large companies running streaming services you likely use, among other 'big' data companies) 20-50tb is if you run your own all time backups (usually with ZFS and the like so divide that by 3 for total usable space). The guys that are running IPtv or other sketchy video streaming and scraping software are hovering around 100TB-200TB in their NAS and none of them actually run user grade hardware... I'm honestly very surprised to hear it referred to as 'smallish'.. At most I'd say 100TB is about middle of the road now days for media horders and small for media content producers. Now my buddy that worked on the CEPH storage backed at CERN would laugh at any of these numbers... but that's a different ballpark all together..
pmiller2 6y ago
You can get more than 8 without going to external enclosures. I have a tower case with 15 drive bays in it.
dzhiurgis 6y ago
There are 30/50/100 TB SSD’s that would fit your coat pocket
snvzz 6y ago
There's progress indeed, but 4x 16TB isn't cutting it. You'd need extra disks for redundancy, extra space for filesystem overhead (including data and metadata checksums), and a sizable amount of ECC memory.
- vbezhenar 6y ago
  You don't strictly need ECC memory for that specific task. Torrents have checksums for every file chunk, so even if some bit corrupted because of RAM, it's enough to re-check the files and re-download corrupted pieces if needed. That said, complete re-check of 64 TB at 250 MB/s would take at least 71 hour. So ECC RAM definitely won't hurt.