3 ms·
>storage clusters at petabyte scale are doing it on AWS. I had to double check just in case, but petabyte is only 1000 terabyte. It may be big in terms of data
by ksec 5y ago
>storage clusters at petabyte scale are doing it on AWS.
I had to double check just in case, but petabyte is only 1000 terabyte. It may be big in terms of database, but rather small in absolute terms. You could fit a single Petabyte in a 1U server.
I doubt they pay listed price. And AWS is now mostly a Enterprise and Sales game. So once you ran other cost involved in managing, I would think you need to be multiple Rack scale before the cost break down better for your own hardware.
And that is excluding other benefits of sitting inside AWS ecosystem. The only thing I think AWS isn't so good at is the low cost, sub $1000 per month spending scenario. Where you are paying a lot more just for staying inside the ecosystem for things you may not be using. Those tends to flavour Linode or DO.
- toast0 5y ago> You could fit a single Petabyte in a 1U server. That seems a bit over the top. I see 18 TB drives available, but let's posit 20 TB drives, so you need 50 of them. I don't think you can fit 50 3.5" drives in a 1U space, even if there's no motherboard or power supply. 50+ drive storage chassis are generally 4U. I did see some 16 drive 1U servers though, so I'm pretty sure you could fit that much storage into 3U even though I also didn't see any 3U storage chassis.
- namibj 5y ago2.5" SSDs are AFAIK the medium for this.
- ksec 5y agoThis has been a thing since 2017 [1] using EDSFF. It is technically possible for 2 PB per 1U, but price and market demand doesn't seems to value these kind of density. So they are mostly used as half petabyte for now. [1]https://www.supermicro.com/newsroom/pressreleases/2017/press170914_32_JBOF.cfm https://www.supermicro.com/newsroom/pressreleases/2017/press...