7 ms·
This is a secondhand anecdote, but it’s pretty funny. Back in the days of server rooms, a friend’s server for his company would reboot every day around 5pm. The
by dumbfounder 3y ago
This is a secondhand anecdote, but it’s pretty funny. Back in the days of server rooms, a friend’s server for his company would reboot every day around 5pm. They checked everything they possibly could with the OS, they would be logged in and running checks on it and it would spontaneously go offline for about 5 minutes and reboot every day. Finally they decided to go stand in the presence of the server around the time it goes down every day. They watched a cleaner come into the room, unplug the server rack, plug in their vacuum and vacuum around the servers, and then plug the server rack back in.
- drivers99 3y agoDefinitely an urban legend at this point. A reddit thread[0] mentions it being collected in 1990 from computer stories going around in the 80s[1] [0] https://old.reddit.com/r/talesfromtechsupport/comments/5yrs16/the_server_keeps_going_down_at_6am/ https://old.reddit.com/r/talesfromtechsupport/comments/5yrs1... [1] https://www.goodreads.com/book/show/3227607-the-devouring-fungus https://www.goodreads.com/book/show/3227607-the-devouring-fu...
- bhickey 3y agoThe story probably endures because things like this actually happen [0, 1] 0. https://www.cnn.com/2023/06/27/us/janitor-alarm-freezer-rensselaer-polytechnic-lawsuit-new-york/index.html https://www.cnn.com/2023/06/27/us/janitor-alarm-freezer-rens... 1. http://www.st-v-sw.net/Obsidian/Martin/gravity.htm http://www.st-v-sw.net/Obsidian/Martin/gravity.htm (search sprinkler)
- drzaiusapelord 3y agoEssentially all these stories are apocryphal. Even this vapor lock story. Sorry but even before today, having a automotive engineer sent to a random person's home over what clearly sounds like a quack letter seems implausible to me. The dictates of capitalism, human resources, and the politics of the workplace would make this difficult if not impossible. Even in the past when there was more human capital in support positions and more of a sense of customer service. Way, way too many suspicious stories involve high-level people being involved in trivial issues. I just find it all pretty suspicious. Real stories tend to start with poor customer service at the dealership and being mocked by managers and mechanics. Not some unrealistic ideal white knight manager sending off engineers to people's homes. Imagine how many weird letters a place like pontiac gets. They don't have the manpower to do this if they actually chose to do it, and engineers might balk at the idea of doing at-home support too. Pretty much any "idealized Americana" business story should set off BS alarms in us. "Oh a trivial problem with your car? No problem ma'am, I'm sending our top engineers over tomorrow," doesn't happen because its costly and unsustainable. Instead ask anyone who has odd car problems. Its endless painful calls and visits to dealerships and mechanics. There's a reason we have lemon laws for cars. Its because whats described in this story doesn't actually happen and people demand restitution. I don't doubt that someone had a famous vapor lock shopping story (ive heard different versions of this story, usually about a housewife picking up her child from a nearby elementary school), but over the years these stories get modified into memetic structures based on dishonesty because most people are social capital seeking and having a humorous story provides them the immature ego boost they need. So "wow my car had vapor lock when I make quick trips" became "So the CEO of Ford came to my house to look at my ice cream car..." The latter is just more interesting in the market of storytelling. That is to say, the ONLY reason this story is here is because its been modified to be memeticly attractive. A "boring" (i find old technology faults interesting, personally), but a "boring" story about vapor lock wouldn't make it to places like HN or reddit, which are memetic responders (upvote/downvote mechanisms) and lowest-common denominator (by this demographic) popularity machines. But dress up that boring story and now everyone is repeating it, often times claiming its their story and they know the people in it! The same way the comment you're responding to probably doesn't actually know the famous "unplug the server at 5pm" person.
- AlbertCory 3y agoWow, you used "memetic" three times. Very erudite.
- bityard 3y agoFrankly I found the whole thing to be shallow and pedantic.
- AlbertCory 3y agoI've swung from -2 to +2 during the day. You're right -- it was obviously a fun engineering legend, and leave it at that.
- yamazakiwi 3y agoWithout vast knowledge, many unreasonable things are seen as reasonable. How much of our history's truth is based on what was told to the gullible majority? Should we not talk about Mythology because a skeptic questions it's authenticity? Comedians make up stories all the time to entertain audiences. These stories don't require accuracy, they are more about delivering specific results; a laugh, a story to share, confirmation bias, etc. Many people lie, believing they're telling the truth. I think you will have a hard time truth policing people who don't and won't care, but focusing on truth and validity is probably a useful skill for you in many parts of your life.
- fragmede 3y agoIf I tell you something I believe to be true, but actually isn't, I'm not lying, just wrong. Lying involves an intent to decieve, so if I don't know the truth, it's not a lie.
- yamazakiwi 3y agoThat is true, in addition, outcomes are not defined by intentions. It was my hope to draw attention to why we perpetuate this behavior (results). There is a lot of gradation, the differences between stating misinformation you believe is true vs stating what the majority believes to be true due to laziness vs an intentional lie, etc.
- permo-w 3y agowould it be surprising if this has happened more than once?
- joshvm 3y agoI mean it actually happens. Not powering down the actual machine, but in my last house the landlord had a cleaner visit every fortnight. Occasionally I came home to find downloads broken or my remote connection would drop randomly in the afternoon. We lived in an old house and had a wifi extender to reach the upper floors (and not enough sockets). The cleaner would unplug the extender to vacuum the kitchen and half the house would go offline. The ice cream story reads too much like a dramatisation to be truly believable, but accidental and repeated unplugging is common I expect.
- btilly 3y agoThe version that I remember hearing was https://www.snopes.com/fact-check/polished-off/ https://www.snopes.com/fact-check/polished-off/. Also false.
- Paul-Craft 3y agoI've never heard that one. It has many more characteristics of a modern urban legend than the simple "janitor unplugs the server then plugs it back in" story. Urban legends are essentially modern day folk tales. They'll often involve fear, horror, or even humor, and they're frequently cast as cautionary tales. They tend to be reasonably detailed (which helps keep a listener's attention), but at the same time they frequently not pinned down to a specific time or place. They're almost always told as secondhand stories (e.g. it happened to "a friend of a friend"), and tend to fall at the edge of plausibility. But, the key thing is that urban legends always reflect some sort of underlying societal belief or worry. "Janitor polishes off patients" is about the fear of death, and how it can come for anyone at any time, and there's nothing they can do about it. "Janitor unplugs server every night at 5" is probably more about the idea that strange things happen sometimes, but it usually turns out that there's a good explanation.
- kalleboo 3y agoI think the vacuum story gets retold because it's so close to real-life stories. The UPS on a server I manage would trip once a week around the same time. The old story came to mind and sure enough, once a week it was time to vacuum and someone would plug in a vacuum cleaner into the same circuit (700W vacuum cleaner on a 100V/15A circuit), causing enough voltage dip to kick the UPS into gear.
- iforgotpassword 3y agoMan I've heard this story so many times, this guy must have a million friends in a hundred countries he's told this story to. :-)
- fernandotakai 3y agofunny thing, something like this happened to me. we were on site doing some implementation and went back to the hotel at about 3am. less than an hour later, we get an email from nagios (i think it was nagios? it was a GOOD while back) complaining the server was offline. we got into a cab and went back straight up (this server was not supposed to be offline ever). guess what? a maintenance guy turned the server off by mistake while cleaning up the server room -- even worse, he was not even supposed to be there! this triggered a bunch of security checks and the company found out that most employees had access to any room in the building.
- SketchySeaBeast 3y agoThe key to making friends is having a good story.
- dkarl 3y agoI think it's more like a common experience. My wife and I both work, so we have cleaners come in every two weeks for a deep clean. We've used several different companies, and apparently it's standard practice to unplug things when a power outlet is needed. They don't unplug computers that have monitors, and they don't unplug things with visible clocks that would need to be reset, so they do take some care not to inconvenience us, but they'll unplug anything else, including NAS appliances, DVRs in the middle of recording shows, etc. When we hire a new company, we make sure they mark down a special request that they not unplug anything, pointing out that we have ample outlets and can help them find one or free one up if necessary. I also replace any network connectors that lose their little plastic locking tabs, because they're likely to slip loose when things get jostled around during cleaning.
- gav 3y agoIt is a common story and sometimes those get put in the collective blender and we get apocryphal stories out of it. Here's two stories of my own: Back in the mid 90s, I built out a system that gave every school in a district their own webpage that was carved out of some government funding for providing internet access. There was no budget for hardware though, so it ended up running on a repurposed workstation in somebody's office. One Tuesday even the cleaners unplugged it to vacuum and it didn't power back up after being plugged in. On Wednesday somebody helpfully stuck a piece of paper saying "don't unplug" to it, which seemed to solve that problem until the whole project was mothballed. In the late 90s, I worked at a company where we started getting complaints from the staff about machines being getting slower over time. Nobody took it seriously until there was an inventory of machines taken and we found that a large amount had significantly less memory installed than they should have, somebody was stealing half the memory sticks from each. Hidden cameras were installed in the office and it turned out that somebody on the cleaning crew came with a screwdriver and ESD bags and knew how much to take to leave the machines working.
- skipkey 3y agoI personally had a similar situation. We had an accounting firm whose servers we were maintaining, and occasionally the print server would reboot, always between 9 and 10 am. So I sat in there for a week between those hours and noticed the light would dim and occasionally the reboot would happen. It turned out that the lawyer next door would come in, turn on his PC, printer and coffee pot simultaneously because they were all on the same power strip, and the drain was causing an undervoltage on the circuit the server was on during startup. We had it on a UPS, but it turns out that at the time consumer grade UPS systems only handled outages. I measured drops as low as to 85 volts, in practice anything under 95 or sou would reboot.
- krisoft 3y agoOh I have a similar one. This one is first hand, I was in the room when we were debuging the issue. We were developing a smart camera product which were counting traffic on a road. So for example a city council would install this camera somewhere on a road and it would generate statistics of how many lorries, and passenger vehicles, and motorbikes used that road. One of our cameras exhibited a problem where it restarted every day around roughly the same time. It wasn't exactly the same second though, in fact there was a clear pattern to it. One day it would restart at 19:12:10 and the next day two second later, then again the third day two more seconds later. (not the real timestamp and i don't remember the real time deltas either, but there was a clear progression) After much debuging we learned that the issue was that as the sun was settling some street furniture projected a shadow in front of our camera. Our software wrongly concluded that it is a vehicle and started collecting information about it for classification. But of course shadows creep a lot slower than real vehicles so it run out of memory before the "shaddow vehicle" has passed out of the frame. And once we run out of memory the system froze and then got restarted by a watchdog. Turns out the pattern we have seen in the timestamps was caused by the angle of the sun changing which made the shadow trick our algorithm just a little bit later every day.
- heywhatupboys 3y agothis is why denmark has an additional slanted plug for IT equipment and a winky one for hospitals
- genewitch 3y agoIn the US the "winky" receptacles that go (-|) or (⊣|) - except the T faces the other way - are 20 amp outlets, 120 volts. every receptacle that differs from the "shocked face" means something. Our standard shocked face receptacles are 15A. In hospitals, you need a guarantee that your monitors or assistive devices aren't going to trip a breaker somewhere if someone plugs in a vacuum; making it impossible to use the receptacle for something else is something that only matters after it's too late, i'd think.
- fragmede 3y agoIn hospitals, they're colored differently to denote which sockets are on backed up lines vs not.
- smcl 3y agoHow can, say, a cleaner tell the prong configuration on a plug when it's plugged in and not visible?
- heywhatupboys 3y agonone, but they sure cant plug in their vacuum. hispital ones are red wires
- smcl 3y agoRight but the point isn’t to stop something being plugged in, it’s to stop something unplugged
- wolverine876 3y ago> Back in the days of server rooms Huh? Yesterday? Or are you referring to the fact that servers are now often offsite, in 'clouds'?
- Cthulhu_ 3y agoPretty much, server rooms still exist in offices but they'll mostly be for the network infrastructure, with most workloads including email and storage having moved to the cloud. Office365 is a really tempting offering, compared to operating your own servers + staff.
- going_to_work 3y agoThis story is older than the internet.
- incidel 3y ago1999, the town hall of a small municipality s/e of Stuttgart Germany. For the 3rd time in half a year me (IT apprentice) and senior developer are onsite to fix one MS SQL db's broken indizes. It's the early afternoon of friday and humid hot, a thunderstorm is on it's way. We toil on and are almost done when at about 16:00 the chief officer turns up and informs us that we have to hurry because at 17:00 all electricity will be cut in the building! Senior developer and me share a shocked glance. "Is this every friday?" "Why yes! We conserve lots of energy that way." Senior and me share another glance and on impulse I speak up. "Isn't the weekly db cleanup scheduled for 16:30 PM on fridays?" The senior developer nods. We spend the remaining hour to fix the problem and then cancel this weeks schedule and manually shut down the DB server for the time being. Every friday these guys cut the power to the building, causing all kinds of production issues with not only their Netware Server but also the DB server for their collections software (our product). As per maintenance contract we were required to repair the DB everytime which was a hassle and a waste of ressources on our behalf. In the end it took another month or so until they relented and rescheduled the hard power down until saturday morning so that all servers could shut down properly even AFTER the backup jobs could complete (backup was also totally broken but they never did check or even perform a restore so they never actually noticed).
- whartung 3y agoSimilarly, we were just finishing up a project for a client and we’re just going through and connecting everything up. The hardware consisted of 6 color terminals (Wyse 350s I think), the server, and 10 PCs with large, 20” tube monitors. We had these all in my bosses office powered through assorted outlets and power strips. The room was wall to wall machinery. It was after hours when the janitor came in and plugged in his vacuum. I looked at him, he looked at me, I looked at my boss, who looked back. We then both turned back to the janitor, who looked at us. Not a word was said as he fired it up. 2 seconds later, the power was out, we blew the breaker. Took us a half hour to get it back on. But it was funny at the time.
- qup 3y agoThis story is my favorite in the thread. Thanks.
- doctorhandshake 3y agoI had a similar experience: I have a permanent dynamic lighting system installed in a food hall / night club. One day about a year after installing the owner called to tell me a fixture was on the blink. The following day, another, the following day, more, but different ones. This was worrying as all the hardware is custom and would be very hard to source replacements for. We investigated lightning strike or other power surge related to construction on the block, water damage, etc. Long story short we found out that the new cleaner, who was VERY VERY thorough, was pulling out the server rack to mop behind it nightly and straining the cat cable terminations.