3 ms·
In terms of the cloud providers other than the big three/four (AWS, GCP, Azure, Oracle) most of your Digital Oceans, Linodes (perhaps pre-Akamai?), etc of the w
by kkielhofner 4y ago
In terms of the cloud providers other than the big three/four (AWS, GCP, Azure, Oracle) most of your Digital Oceans, Linodes (perhaps pre-Akamai?), etc of the world are almost all certainly colocated. As others have noted the "big ones" typically operate with a blend - green field physical construction for the big and dense facilities combined with floors/cages/etc in colocation facilities for areas around the world with lower hardware requirements.
Colocation facilities are interesting (I've been in a lot of them) and they generally (physically) fall in two buckets:
1) Repurposing of old telecom (and even telegraph!) buildings. CoreSite (a colocation provider) has a few floors (last I looked) in The Telegraph Building in Chicago[0]. If you look at the pictures of the exterior of the building it still says Western Union on the side! There are some interesting aspects of these - most of them are located in downtown areas. If you start looking around in major cities you will start to notice gigantic nondescript buildings with minimal signage, almost no foot traffic, and almost no (if any) windows[1]. If they have any signage at all it will typically be "Something Bell", Western Union, AT&T, etc. These facilities are interesting for a variety of reasons. Because they are repurposed telegraph and telecom buildings going back to the days of mechanical telecom switching[2] and DC battery banks they have floor load ratings that are just incredible. Something like 20x or whatever of a typical high-rise. Downside of these facilities is that on a square footage basis they typically can't support the cooling (and often electrical) requirements of modern compute equipment which is much more dense than the extremely heavy but relatively cool/low power mechanical switches and other equipment from decades ago. If you look at the picture of the Telegraph Building you will notice it's literally right next to the Chicago Stock Exchange. Needless to say these facilities are really popular for HFT stuff.
2) Purpose built facilities. These are typically located near population centers (for access to peering and other fiber) but out of downtown areas. Examples here are CH7 and CH3 from Equinix[3]. These are still close enough to major peering points and fiber distribution so access and latency isn't terrible but being in more "suburban" areas. Here they have more space to build, real estate is cheaper, and interestingly since 9/11 there has been a movement of sorts to move major hosting facilities outside of densely populated areas/potential terrorist targets.
Then for your Google, Facebook, NSA, etc of the world they can build in fairly remote (rural) areas where they have essentially unlimited space and significantly higher security[4]. The kind of thing where law enforcement and private security can setup perimeters where if you get anywhere near the actual hosting facility you better have a reason to be there - as opposed to a downtown facility where thousands of people walk and drive by everyday without ever knowing it's there.
[0] - http://wikimapia.org/30789188/Telegraph-Building-CoreSite-Data-Center http://wikimapia.org/30789188/Telegraph-Building-CoreSite-Da...
[1] - https://nypost.com/2018/06/26/nsa-using-att-data-center-in-hells-kitchen-for-spy-program/ https://nypost.com/2018/06/26/nsa-using-att-data-center-in-h...
[2] - https://www.youtube.com/watch?v=xZePwin92cI https://www.youtube.com/watch?v=xZePwin92cI
[3] - https://www.equinix.com/data-centers/americas-colocation/united-states-colocation/chicago-data-centers https://www.equinix.com/data-centers/americas-colocation/uni...
[4] - https://nsa.gov1.info/utah-data-center/ https://nsa.gov1.info/utah-data-center/
- jdoss 4y agoThe Coresite building you are talking about is 427 S. LaSalle and Coresite owns the whole thing. I worked for a company that was customer #1 on the first floor around 2007 or so when they were still renovating the building. We moved 4 racks from 600 South Federal Street which was owned by Digital Reality Trust. Coresite built out 427 over time and IIRC Google has the entire 5th or 6th floors or at least they did back when I left the company in 2015.
- kkielhofner 4y agoSure is (first link has the address). I was there once around '09/'10 for a tour and only remember them showing 2-3 floors which, again from what I remember, was the shared colocation space at the time. IIRC at least one floor was newly built out and barely occupied. We signed with them and I never had to go inside again. As far as Chicago goes from what I remember someone at the company had a bad experience with DRT so we never looked at 600 S Federal but we did look at Equinix at 350 E Cermak (which REALLY stands out) and a handful of others that weren't memorable. Thanks for the added detail!
- kelp 4y agoBeing inside those old repurposed telecom buildings can be WILD. I was in one that had overhead bundles of ethernet and fiber that had to be multiple feet thick, with the ladder rack bowing down under the weight. Elevator shafts were repurposed for running wires and fiber. And then the building Google owns in Manhattan: https://en.wikipedia.org/wiki/111_Eighth_Avenue https://en.wikipedia.org/wiki/111_Eighth_Avenue That had a bunch of carrier hotels in it, I'm not sure if Google managed to kick them all out yet, since many had long term leases. But the building has a bunch of truck elevators in it... literally can load a truck up into the building. And a ton of fiber connectivity's which is why the carrier hotels were in there.