3 ms·

> For some companies this would mean creating a whole department to manage that. If you are already managing that much data, you already have a whole departmen

> For some companies this would mean creating a whole department to manage that. If you are already managing that much data, you already have a whole department to manage that. And in the end I haven't seen a significant decrease of people to manage stuff in the cloud. Sure you don't have to manage the hardware infra but you still manage tons of smaller virtual infrastructures on a myriad of AWS accounts. Sysadmins just get relabeled cloudops, devops and/or devsecops , end up being paid more, and thus more expensive. That is at least my observation. I get paid more than I used to but the management hasn't been simplified. The only thing that has changed dramatically is you aren't dependent anymore on delivery time for storage, servers and network equipment.

paxys 3y ago
Managing the data and managing the infrastructure to host that data are very different problems. As discussed elsewhere in this this thread you can store 100 petabytes of data in glacier for $1.2M/yr. That's literally the cost of 1-2 experienced engineers.
- prmoustache 3y ago
  1. chance is that such amount of data is not sitting alone. It is online to be accessed. So you can't just factor glacier as a single cost. 2. a datacenter doesn't require many employees, most of them not being engineers themselves. To get back to my remark on point 1, while managing your own datacenters just to host storage would be expensive, it is usually mutualized with the rest of the infrastructure you need to access and use the data. 3. colo datacenters
- vidarh 3y ago
  That might be the cost of 1-2 experienced engineers in Silicon Valley. So don't host there. $1.2m is also for the Deep Archival storage class which has 12 hour retrieval times, and so competes with a handful of tape robots w/caching. It's not something you would have 1-2 experienced engineers spend full time managing - it's something you'd have remote hands and a support contract in place for, and your engineers spending a small fraction of their time managing.
hodgesrm 3y ago
> And in the end I haven't seen a significant decrease of people to manage stuff in the cloud. This is a really important point. Virtually every customer that I work with who runs in the cloud has a platform group focused on cloud operation. They don't rack gear any more. Instead they do things like setting up IAM consistently that are beyond mortal ken. (Well mine, anyway.)

paxys 3y ago

Managing the data and managing the infrastructure to host that data are very different problems. As discussed elsewhere in this this thread you can store 100 petabytes of data in glacier for $1.2M/yr. That's literally the cost of 1-2 experienced engineers.

prmoustache 3y ago
1. chance is that such amount of data is not sitting alone. It is online to be accessed. So you can't just factor glacier as a single cost. 2. a datacenter doesn't require many employees, most of them not being engineers themselves. To get back to my remark on point 1, while managing your own datacenters just to host storage would be expensive, it is usually mutualized with the rest of the infrastructure you need to access and use the data. 3. colo datacenters
vidarh 3y ago
That might be the cost of 1-2 experienced engineers in Silicon Valley. So don't host there. $1.2m is also for the Deep Archival storage class which has 12 hour retrieval times, and so competes with a handful of tape robots w/caching. It's not something you would have 1-2 experienced engineers spend full time managing - it's something you'd have remote hands and a support contract in place for, and your engineers spending a small fraction of their time managing.

hodgesrm 3y ago

> And in the end I haven't seen a significant decrease of people to manage stuff in the cloud. This is a really important point. Virtually every customer that I work with who runs in the cloud has a platform group focused on cloud operation. They don't rack gear any more. Instead they do things like setting up IAM consistently that are beyond mortal ken. (Well mine, anyway.)