5 ms·

Putting 24TB parts in a Backblaze Storage Pod 6.0 would presumably allow 1440TB in a 4U rack mount server.[1] In practice, how would you reach the same density

Putting 24TB parts in a Backblaze Storage Pod 6.0 would presumably allow 1440TB in a 4U rack mount server.[1] In practice, how would you reach the same density with SSDs? (I haven't looked into it, just curious if you know that SSD options more dense than that exist, and whether they are equally openly documented.) [1] https://www.backblaze.com/blog/open-source-data-storage-server/ https://www.backblaze.com/blog/open-source-data-storage-serv...

ddulaney 6y ago
There aren’t many full open-source solutions available, but you can buy 100TB 3.5” SSDs for data center use.[1] At Storage Pod densities, that’s 6000TB in 4U. I’m not sure if some other factor comes in that limits density, but that’s a first-order estimate. [1] https://nimbusdata.com/products/exadrive/pricing/ https://nimbusdata.com/products/exadrive/pricing/
- rbanffy 6y ago
  Heat dissipation may be a concern, but, if we are talking 6PB of flash storage, we can pretty much consider custom liquid cooling is an option.
mciancia 6y ago
Well, there are 100tb 3.5" SSDs available...
- ReptileMan 6y ago
  Let me guess - if you have to ask for the price, you can't afford it ...
  - vxNsr 6y ago
    price isn't that bad... only $40K[0] [0]https://www.newegg.com/nimbus-data-dc-100tb/p/2U3-002M-00004?Description=exadrive&cm_re=exadrive-_-9SIAPE6BRD0283-_-Product https://www.newegg.com/nimbus-data-dc-100tb/p/2U3-002M-00004...
    - iptrans 6y ago
      Gotta love that $29.00 shipping charge. It's not like they could have afforded to offer free shipping at those prices :)
brigade 6y ago
There are 1U servers with 32 EDSFF slots, which were advertised to reach 1PB with 32TB SSDs. But 16TB is more common, and that's still 2PB in 4U that you can buy today without getting into exotic pricing.
- marmaduke 6y ago
  If 2PB SSD is not exotic pricing.. I’m glad I can work with off the shelf stuff.
detaro 6y ago
SSDs are smaller, so you can pack more of them in the same volume. Not aware of really open designs (maybe in the OpenCompute project there are some), but just from a quick look at Supermicros homepage: Something like https://www.supermicro.com/en/products/system/1U/1029/SSG-1029P-NEL32R.cfm https://www.supermicro.com/en/products/system/1U/1029/SSG-10... can fit 32 SSDs à 16 TB in a 1U system (Intel at some point announced 32 TB models in the same format, but I'm unsure if they ever were available). This style can fit 48x 16TB in 2U: https://www.supermicro.com/en/products/system/2U/2028/SSG-2028R-DN2R48L.cfm https://www.supermicro.com/en/products/system/2U/2028/SSG-20... The trouble with such dense SSD capacity is more being able to interface them fast enough with the host and the outside world.
jeffbee 6y ago
You can put 36 15TB NGSFF SSDs into a 1U height enclosure and only 12cm deep. SSD volumetric density is a lot higher than disk and has been for a few years now.

ddulaney 6y ago

There aren’t many full open-source solutions available, but you can buy 100TB 3.5” SSDs for data center use.[1] At Storage Pod densities, that’s 6000TB in 4U. I’m not sure if some other factor comes in that limits density, but that’s a first-order estimate. [1] https://nimbusdata.com/products/exadrive/pricing/ https://nimbusdata.com/products/exadrive/pricing/

rbanffy 6y ago
Heat dissipation may be a concern, but, if we are talking 6PB of flash storage, we can pretty much consider custom liquid cooling is an option.

mciancia 6y ago

Well, there are 100tb 3.5" SSDs available...

ReptileMan 6y ago
Let me guess - if you have to ask for the price, you can't afford it ...
- vxNsr 6y ago
  price isn't that bad... only $40K[0] [0]https://www.newegg.com/nimbus-data-dc-100tb/p/2U3-002M-00004?Description=exadrive&cm_re=exadrive-_-9SIAPE6BRD0283-_-Product https://www.newegg.com/nimbus-data-dc-100tb/p/2U3-002M-00004...
  - iptrans 6y ago
    Gotta love that $29.00 shipping charge. It's not like they could have afforded to offer free shipping at those prices :)

brigade 6y ago

There are 1U servers with 32 EDSFF slots, which were advertised to reach 1PB with 32TB SSDs. But 16TB is more common, and that's still 2PB in 4U that you can buy today without getting into exotic pricing.

marmaduke 6y ago
If 2PB SSD is not exotic pricing.. I’m glad I can work with off the shelf stuff.

detaro 6y ago

SSDs are smaller, so you can pack more of them in the same volume. Not aware of really open designs (maybe in the OpenCompute project there are some), but just from a quick look at Supermicros homepage: Something like https://www.supermicro.com/en/products/system/1U/1029/SSG-1029P-NEL32R.cfm https://www.supermicro.com/en/products/system/1U/1029/SSG-10... can fit 32 SSDs à 16 TB in a 1U system (Intel at some point announced 32 TB models in the same format, but I'm unsure if they ever were available). This style can fit 48x 16TB in 2U: https://www.supermicro.com/en/products/system/2U/2028/SSG-2028R-DN2R48L.cfm https://www.supermicro.com/en/products/system/2U/2028/SSG-20... The trouble with such dense SSD capacity is more being able to interface them fast enough with the host and the outside world.

jeffbee 6y ago

You can put 36 15TB NGSFF SSDs into a 1U height enclosure and only 12cm deep. SSD volumetric density is a lot higher than disk and has been for a few years now.