14 ms·
> Additionally because there are no people, we can take all the oxygen and most of the water vapour out of the atmosphere which reduces corrosion, which is a si
by cm2187 8y ago
> Additionally because there are no people, we can take all the oxygen and most of the water vapour out of the atmosphere which reduces corrosion, which is a significant problem in data centres
First time I hear corrosion is a problem in datacentres. I never noticed any corrosion on any machine at home or work. Does it have to do with the cooling of datacentres?
- linead 8y agoI wondered about this as well : https://www.researchgate.net/profile/Michael_Schappert/publication/224237295_Corrosion_management_for_data_centers/links/551416740cf2eda0df303ffb.pdf https://www.researchgate.net/profile/Michael_Schappert/publi... Seems like its a combination of cooling data centres (flowing air) and the quality of the air being circulated. So if there are pollutants in the air they pose a danger to the circuitry. Never occurred to me this was yet another thing to be wary of when running a data centre!
- iamshs 8y agoMaybe it is related to mitigation of sea water facilitated corrosion?
- mpweiher 8y agoI think part of it is that even problems that are small/unnoticeable at the individual level become big when multiplied by a huge N. For example, I don't think I've ever had a hard drive fail in ~30 years in computing, well without being dropped that is, yet look at the Backblaze reports: https://www.backblaze.com/blog/hard-drive-benchmark-stats-2016/ https://www.backblaze.com/blog/hard-drive-benchmark-stats-20...
- WalterBright 8y agoI have. Including things like the heads falling off and spinning around, grinding everything to junk.
- SOLAR_FIELDS 8y agoThat sickening click sound that a disk drive makes when it's on the verge of failure is ingrained in my head. I tried putting one of those in the freezer once, and maybe it was a folk remedy, but it worked enough to boot and get my data off!
- apk-d 8y agoThat must be one of the silliest hacks I've ever heard, right up there with oven-baking electronics to fix loose solder joints. I love it!
- Qworg 8y agoIt works because of how hard drives work - the heads are extended by slightly heating the bar the heads are connected to. If you're head crashing, you need a little less length, hence freezer.
- pjc50 8y agoThis isn't quite true, the heads are kept from crashing by air pressure and a crash does irreversible damage. The "clicking" sound is either the heads flicking back and forth as the drive tries to seek, or the central motor trying and failing to start platters spinning which are jammed on the bearing. What freezing the drive may achieve is either un-sticking it from the bearings (see also the "bang drive on edge" technique), or lowering the thermal noise floor in the electronics enough for marginal components to make it through the boot sequence. It's not recommended. https://www.gillware.com/blog/data-recovery/hard-drive-freezer-data-recovery-myth/ https://www.gillware.com/blog/data-recovery/hard-drive-freez...
- Qworg 8y agoAh, interesting! Thanks for the correction. I was off the project before we put in the drives obviously. ;)
- 8y ago
- sambeau 8y agoI've seen a whole batch of hard drives fail: one-by-one the company's employees' PCs failed over a period of a week or two. They had all been bought together in a single upgrade. I (on a Mac) was unaffected (and no doubt a little smug).
- deleted 8y ago[deleted]
- icebraining 8y agoMy N is just 10, yet I've had two failures :(
- deleted 8y ago[deleted]
- theandrewbailey 8y agoI killed a hard drive when I swapped motherboards about 15 years ago. I suspect static electricity.
- deleted 8y ago[deleted]
- overcast 8y agoThat's just unbelievable. To even survive the Deskstar era blows my mind. Not a single drive?
- drbawb 8y agoThat's not all that surprising to me, I've had supremely good fortune with drives. I have a Maxtor Fireball that still "works" (though its SMART has failed.) My current workstation still has drives in it from the three prior workstations; spanning back 7 or 8 years now[1], humming along well outside their warrantied operation. The first disk failure(s) I witnessed came while I worked at a computer repair shop, which would be "a huge N" compared to the number of PCs I've personally owned. My first disk failure on my own personal equipment didn't happen until I built out a home storage array - again a rather large multiplier of number of disks compared to a traditional PC. Even then that failure was because a disk controller got fried, the drive was mechanically sound and the data was completely recoverable. Admittedly my own experience is probably a bit skewed since I don't have a personal laptop. By the time I got a job that provided me w/ a laptop solid state drives were already quite mature. In my experience doing repair work: laptops were a huge source of our failed drive & data recovery operations. [1]: I should note these drives all operate nearly 24/7, no five-nines on my personal equipment though ;-P
- HankB99 8y agoUp until a couple years ago I could have said the same. I even have a couple deathstars on the shelf that were operational when retired. In the last couple years I've had several HDDs fail starting with a 2TB Seagate (one of the "stars" in the Backblaze stats.) I've had others fail since, mostly multi-TB drives. I had one nearly ten year old 200GB drive begin to report remapped sectors. I've even had an SSD develop an unrecoverable error.
- Declanomous 8y agoMy dad managed to kill a 2 year old Samsung SSD; it wouldn't even show up on the bios. Tech support was so incredulous they actually had an Electrical Engineer on their staff call him. I didn't believe him either. I was like "Dad, SSDs are designed to fail in a way you can recover data. What SATA cable are you using? Is the port dead?" Turns out it was literally the drive.
- elorant 8y agoMy guess is that you change disks often. I've had multiple fails over the years, either from overheating or more often from overuse for extended periods of time (aka more than five years). Although I've never had a failure before the guarantee expired.
- Sami_Lehtinen 8y agoYesterday I lost 3TB Toshiba TD01* series drive 23,75 months in (home) use. Only 4800 hours powered on. And it started to seek fail, even SMART showed it. It failed one week before warranty ended. Ha!
- ams6110 8y agoEven managing just a few hundred nodes, I see hard drive failures pretty routinely. Servers hammering on storage devices 24x7 are much different from desktop computers. I've never had a hard drive fail on my own desktop machine, though I know people who have.
- williamdclt 8y agoThe only hard drive I've broken was because a let a pretty powerful magnet fall on the computer, right on the spot the HDD is. Never play with magnets next to your computer.
- Coffeewine 8y agoThat backblaze report is absolutely fascinating! I'm curious though what the statistics would be from a more consumer point of view, with regards to quantity of use, operational temperature and so forth. I imagine most consumer drives sit idle almost all of the time, whereas theirs are more likely in constant use. That said, that paints a pretty handy real world picture of what one might expect.
- r00fus 8y agoI had a PC I built and moved to a bungalow near the beach. Within the year it's power supply had rusted. My last PC in a relatively arid environment lasted 4 years. It's probably the "sea" environment that would pose corrosion issues.
- setquk 8y agoPower supplies are usually plated or coated recycled "chinesium" steel. This is because it's incredibly cheap and has a half decent EMC outcome for the price. One little nick in the coating or plating and that's it though. Really they could use other materials such as cast aluminium, brass or copper but they are orders of magnitude more expensive. If you look at some of the older electronic test equipment which was made with much higher standard materials it's not uncommon to find something that has been in a damp shed for three decades and powers up just fine after the dead spiders have been removed and the mould cleaned off. BUT at the time of manufacture they cost more than a mid-range car.
- GraemeL 8y agoIn an interview on Radio Scotland, the project lead said the container is sealed with an inert gas replacing the air and with a significantly lower water vapour content than the atmosphere.
- outworlder 8y agoThere is a stark difference depending on which sea you are located at. I used to live close to the Atlantic ocean, near the equator. The failure rate of electronic components was through the roof. Random memory failures (due to contaminants in memory contacts) as well as corrosion in copper traces in the PCBs. At least one instance of motherboard fire. I'm now close to the Pacific. No issues whatsoever.
- MasterPI 8y agoI think it has to do with the humidity of the air.
- joatmon-snoo 8y agoHere's an interesting piece: http://computer.expressbpd.com/news/ctrls-shows-how-data-centers-can-fight-corrosion-due-to-pollution/24975/ http://computer.expressbpd.com/news/ctrls-shows-how-data-cen... tldr: gaseous contaminants corrode silver/copper components of circuitry
- discodave 8y agoSome AWS techs in Oregon from a few years ago have a fun story for you.
- opencl 8y agoI think it's mainly a problem in highly polluted urban areas because of sulphur dioxide in the air. Most datacenters use enough air conditioning for moisture to be a non-issue.
- ams6110 8y agoA trend in energy-efficient data centers is to maintain temperatures and humidity at near the maximum acceptable levels to reduce energy use for cooling and dehumidification. Data centers used to be like walk-in refrigerators. Now the air is borderline uncomfortably warm and slightly "heavy" with humidity.
- coffeeacc 8y agoSounds like underground in the desert would be suitable?
- Faaak 8y agoExcatly. I know one which only does free-cooling (they only have big fans; that's it). Failure rate is a bit higher, but they are confident that their architecture is HA/redundant and of what they told me, it's cheaper to replace hardware (they got some DELLs "fresh-air" servers) than to cool the DC.
- semanticist 8y agoThe industrial scale cooling used in datacentres can produce weird results, like when it rained inside Facebook's first datacentre: https://www.theregister.co.uk/2013/06/08/facebook_cloud_versus_cloud/ https://www.theregister.co.uk/2013/06/08/facebook_cloud_vers...
- dlhavema 8y agoSounds like tehy didnt know about this building [1]. That happened like 50ish years ago 1: https://roadtrippers.com/stories/boeing-factory https://roadtrippers.com/stories/boeing-factory
- dwyerm 8y agoYes. The air quality -- especially the amount of sulfur in the air -- contributes to sulfur creep corrosion. Run that through an image search to see the results. It's pretty dramatic. Some of this equipment looks like it had been underwater. But while the older equipment was pretty stable (so long as the capacitors didn't bulge), today's equipment usually has to comply with ROHS. Lead, for all its faults, has a very well-understood corrosion mechanic. The exotic blends used to replace it, we're discovering, aren't always so great... You know, now that I think about it, I wonder how many cell phone warranty claims have been denied for water ingress were actually due to poor solder choices? Color-changing stickers aside, of course.