11 ms·
I understand this is ACM, but I would say the decline has strictly been a failure of software. Specifically, corporate IT's failure to deliver general purpose
by ethbr1 3y ago
I understand this is ACM, but I would say the decline has strictly been a failure of software.
Specifically, corporate IT's failure to deliver general purpose development tools usable by anyone in a company to make computers do work for them (aka programming).
There's still a ton of general value that could be delivered by general purpose processors/computers.
But instead, most non-programmers live in a Kafkaesque reality where the only programs they have access to don't do what they want, and so their work becomes "working around the bad program."
I helped a lady on Friday at a midsized bank whose job it was to take a set of dates in an Excel file, search each one individually into an internal search tool, then Ctrl+f the result report and verify that every code listed in the original document exists in the report.
For 100+ entries.
Every month.
In 2023.
What the fuck are we doing as a society, that this lady, with a machine that could compute the above in a fraction of a second, has to spend a decent chunk of her work time doing this?
Example specifically chosen because I've seen innumerable similar "internal development will never work on this, because it's too small of an impact" issues at every company.
Computers should work for us. All of us. Not the other way around.
- glandium 3y agoKind of a counterpoint: I've heard countless stories (albeit, in Japan) of people doing things like "manually" doing additions of numbers they already have in a spreadsheet instead of just asking Excel to do the addition in what, two clicks, because they "can't trust the computer to do it right" which sounds like a BS rationalization to justify that they wouldn't have much of a job if the computer was doing it.
- cratermoon 3y agoPerhaps some folks here are too young to remember the Pentium FDIV bug[1], but it's not complete BS to distrust the calculations. 1 https://en.wikipedia.org/wiki/Pentium_FDIV_bug https://en.wikipedia.org/wiki/Pentium_FDIV_bug
- RajT88 3y agoBack in 2009, I visited Tokyo for work. What I learned from the folks in my local office is the deployment software my company made tooling for was not very popular. The reasons were mainly that most of that software was made by Western (English speaking, specifically) countries and they did not trust it. They were not exactly wrong - software tends to work best on English systems, unless it was developed by a local company. I heard of some really embarrassing Korean translation issues that even as a person just with Google as my Korean language skill, I could validate the translation issue. Like Korean 101 kinda mistakes. So Japanese companies were using vastly inferior deployment software, which would basically RDP into an interactive session and replay inputs, because that software worked fine in Japanese. ...Or also very common was sneakernet deployment with DVD's and thumbdrives, making the lowest workers do the running around. *I do not know the current state of software deployment in the Japanese market.
- MichaelZuo 3y agoIf I was a busy decision maker at a major Japanese firm with a dozen direct reports and a hundred balls in the air simultaneously, and if I could even spot translation issues in a few minutes on the polished demo presented to upper management, then there's no way I would ever assume anything is correct with the software when I'm not looking. Let alone my subordinate's subordinate's subordinate who would actually be using the software day in day out with their job on the line. So it's a very sensible heuristic. If it's supposed to be a serious enterprise software product, offered for sale in Japan, then spending a few million dollars to hire expert technical translators to double check everything should not be an issue.
- SoftTalker 3y agoI mean not exactly the same thing but just last night Apple Maps was directing me to turn down a street that had clearly been closed for some time. Computers "make mistakes" all the time in most peoples' experience and after you get burned a few times (especially if you get badly burned, like getting fired over the "mistake") you learn to not blindy trust computers.
- JohnFen 3y agoBeing a developer for a number of decades has firmly taught me to never blindly trust computers. Even if the software is flawless (which is literally never the case), there's still the GIGO problem which your Apple Maps example demonstrates.
- genewitch 3y agoI once got fired because i upgraded a company's wifi network from a single apple wifi bridge (the residential one!) to a managed linksys or netgear deployment, and there was a bug in the firmware. I don't recall the bug, but it made the chief lawyer's apple laptop drop connectivity to their printer or something a few times the first day. I opened a support ticket, and got confirmation of the bug - at around 8PM, forwarded the email to my boss, and was fired the next afternoon. what a crap company. They folded within 4 months IIRC, and listed me as the "financial contact" for the fiber optic internet links - got a bunch of nasty phone calls later in the year about needing to pay 5 digits in billing arrears!
- gavinhoward 3y agoIIRC, Excel uses floating point for calculations, so they're not wrong.
- ben_w 3y agoIt also uses them for phone numbers, if you're not careful. I have, in real life, received an SMS from… let's see… 4.4786e+11 welcoming me to Germany and giving me a link to the German COVID quarantine and testing rules (I was already in Germany at the time, I just turned off Airplane mode for the first time in 6 months).
- matheusmoreira 3y agoAnyone who trusts computers to do non-integer math correctly does not know anything about floating point numbers.
- fomine3 3y agoI trust, but they compute in a different form of numbers
- MrLeap 3y agoA large amount of inefficiency is actually a chain of accountability. Trust, and failing that assigning blame, and trusting those assignments, is the root of so. much.
- namaria 3y agoThe whole of life is built on inefficiency. Earth is just a filter for slowing down the diffusion of star energy from the Sun and step it through ecosystems complexity before it being lost to the vacuum. I have no idea why people can be so obsessed with order, control and efficiency when life itself is just the interval of disorder, freedom and delay in energy dissipation.
- dTal 3y agoWhile this is true and arguably of more importance, the thesis of the article was something quite specific: "the economic cycle that has led to the usage of a common computing platform, underpinned by rapidly improving universal processors, is giving way to a fragmentary cycle, where economics push users toward divergent computing platforms driven by special purpose processors". This is likely to exacerbate the issue you describe, but it is not caused by it. I don't think your observation was any less true 20 years ago either. There hasn't been a "decline", as such - more of a failure to realize potential. Office Space (1999) was full of people doing mindless busywork that could easily be automated.
- ethbr1 3y agoFrom a hardware perspective, the ACM cycle discussed is tightly tied to continued general purpose CPU performance gains. There are many pure-performance classes of software, where more performance = more value. Those classes have been diverging since the 80s (media playback), 90s (graphics), 00s (mobile), and ~10s (gpgpu). But there are other classes that are functionality limited. E.g. electronic medical record or enterprise resource planning. If software functionality were more plastic or expanded in those, the same general purpose performance would then be more valuable, and investment would also be incentivized. Accepting the inevitability of divergent, harder to user-program platforms, when we still have a lot of value on the table feels premature. And like it bodes badly for further losses of user computing-sovereignty as hyper-optimized hardware makes cloud platforms more attractive and kills off user-owned processing.
- karmakaze 3y agoThis sounds like a perfect use-case for automation using recorded macros. The failure (or perhaps solutions exist) is lack of facilities in our desktop OSes.
- glandium 3y agoAFAIK, macOS is the only OS to come with this sort of things out of the box (and that is supposed to work consistently across all applications; good luck with that on Linux). https://en.m.wikipedia.org/wiki/Automator_(macOS) https://en.m.wikipedia.org/wiki/Automator_(macOS) https://en.m.wikipedia.org/wiki/AppleScript https://en.m.wikipedia.org/wiki/AppleScript
- karmakaze 3y agoThat is what I had in mind as I wrote it. Sad that many macOS apps now are built with Electron, or we simply use web browsers to access public or internal apps.
- depressedpanda 3y agoUsing web browsers to access apps is actually a boon in this regard: the whole UI is exposed via the DOM, and you can use JavaScript to interact with it for macros -- and it's cross platform as it works on any OS that can run a web browser! In contrast Automator/AppleScript only works on macOS afaict.
- skydhash 3y agoBut then you got the ugliest DOM. I left FaceBook because I was trying to curate my friends list (2k+) down to only the person I know in the real world. But the Unfriend process was a dark pattern and automating it was more work than it was worth. Instagram was worse.
- dr_kiszonka 3y agoThere is a free Power Automate Desktop for Windows.
- bee_rider 3y agoIt would be nice if there was a general expectation by now that people would have a sort of “intro to scripting” type class in high school. Not everyone has to be a programmer, in the same way not everyone needs to be an author, but everybody ought to be able to write a memo, email, or shopping list.
- asdff 3y agoTake it a step further and teach actual data analysis and statistics that are not coin flip/compound interest plug and chug into the calculator problems. No matter what sort of job you do in life, being able to pull a csv from all your different credit or debit accounts and draw some inferences from that would be so useful.
- eru 3y agoJust because something fancy (or even basic) is on the curriculum doesn't mean that anyone is learning anything. No matter how well meaning, high school barely teaches most people anything in practice.
- bee_rider 3y agoI’m not sure what “actual data analysis” is exactly, but it sounds like something that would be better handled in a stats or science class. Though, if programming were taught as a basic problem solving tool like writing and arithmetic, just stuck in the toolbox, a science class would probably benefit from having it there. For example, if it was expected that a kid could do programming as well as they can write a lab report, then it would probably be easy enough to add some sort of “call Numpy to do a linear regression” type section at the end of every lab report. This sort of programming is an everyday force multiplier, and it ought to be taught as such.
- eru 3y agoLook at all the other classes people are already sitting through for high school and not learning anything either. What makes you think this one would be any different? Already around the world high schools all have something highfalutin like 'teaching critical thinking' in their curriculum.
- opportune 3y agoBut surely she had the tools to do that in excel itself, no? This is something I see a lot in software, where people devalue and trivialize the skills and abilities needed to make software simply because they know something is possible to do in software and because, as a software worker, they most likely had a natural predilection towards the kind of thought processes that led them toward pursuing software work. I think it's fallacious to think everybody has the natural disposition and curiosity to want to write software. Writing has been around forever, and most people don't want to do it beyond purely functional communication, and even those who do want to go beyond that are mostly terrible at it. That lady could have automated her job if she really wanted to and was motivated enough to do it; she simply preferred to be a ditch digger than to design a ditch digging machine. It doesn't help that "designing ditch digging machines" is in such high demand that most companies are really only able to hire mediocre people to fill those roles. Leonardo da Vinci is not working on sox compliance at a fucking bank. There's a good chance that the payoff for that bank automating "take a set of dates in an Excel file, search each one individually into an internal search tool, then Ctrl+f the result report and verify that every code listed in the original document exists in the report" is not even there, because the first attempt will have insufficient monitoring or verifications to catch silent failures and introduce an expensive issue caught months after the fact that leads to a huge remediation scramble and requires more development than initially expected to address, not to mention the constant need for maintenance in updating the software and making sure it continues to run (which also involves a rotating cast of programmers joining, needing to learn the software, and leaving). Leonardo might do it right the first time, but he's not doing it for cheap and not going to make it his life's work. Joe Schmoe can do it cheaper but it's going to take a while, have an ongoing maintenace burden, and probably some mistakes made along the way. That lady can do it for even cheaper than Joe Schmoe can without many headaches.
- conception 3y agoYou see this in manufacturing as well. You’d think robots would be everywhere but often, like way more than you’d imagine, it’s cheaper to hire a human to do it.
- 3y ago
- makeitdouble 3y agoThere's many situations where manually dealing with 100+ records is a decent tradeoff. I feel people in our field overestimate the actual complexity of many dumb looking tasks. From your bank employee example, it looks like your solution would be to open the bank's internal tool to her excel instance, have it somewhat find the right records and inject the right value, while checking the listed codes. That looks like a series of APIs if they care about data exposure, or huge CSV exports that they need to then track ? And as it seems to be important enough to warrant verification, it means your program is not some random batch, it needs significant validation. Then picture the internal tool changing its output format. Reports getting categorized differently because of organizational change. New fields being added to follow new legislations. The tool could break at any of these changes, and the lady's left with a broken system except a lot of money has been invested, it's supposed to have solved her problem, she might not have the same access to data she had before the integration, and overall the situation could be worse than before. That feels like a bleak scenario, but it happens all the time as well.
- jiggawatts 3y agoIt’s basically a JOIN, the most fundamental data manipulation operator. If you can’t automate this, then you don’t “get” computers at all. I once had two guys arguing next to me about how it was impossible to produce a simple report about VM storage utilisation in under a month. I produced the report, printed it out, and shoved it in their hands just to shut them up while they were still busy arguing. A “month” of work required five joins.
- radlad 3y ago> It's basically a JOIN The comment you're replying just explained why this is not "basically a JOIN." There are two unrelated systems (not SQL databases) which don't expose any APIs to the analyst.
- tuatoru 3y agoIt's still basically a join. If it's on a computer, it can be converted to text files, and then it can be JOINed, one way or another.
- userbinator 3y agoWhat the fuck are we doing as a society, that this lady, with a machine that could compute the above in a fraction of a second, has to spend a decent chunk of her work time doing this? To put it bluntly: do you want her to be unemployed instead?
- tuatoru 3y agoThis is the "lump of labor" fallacy. If she turns up to work reliably, and stays on-task, there are no end of other things she could be doing that increase general welfare more than this.
- radlad 3y agoMaybe, but I'm not sure everyone has the inclination to become a programmer. And the whole thread was about how computers should work for everyone, including this lady whose job could be automated. Which begs the question: do most people actually want general purpose computing? Or does the average human prefer "apps"?
- tuatoru 3y agoWho said anything about her becoming a programmer? An interior decorator, or a gardener, or a nurse aide, or a yoga instructor, or a nail technician: they all add more to human welfare than this task. If she wants to become an architect, or a water system engineer, more power to her!
- rrr_oh_man 3y agoNot disagreeing with your point in general, but: Not everyone can become an architect or water systems engineer at 50, after having worked a "general assistant" type office job for many years. I think that (and its consequences) might be the biggest short term societal risk of automation in an aging society. How would you solve this problem?
- 3y ago
- omscs99 3y agoHypothetically, if she figured out how to automate it on her own, would she get any kind of reward for it? If not, why should she automate it? Another example, if there’s some repetitive task that you automate at a software dev job, would you get rewarded for figuring out how to automate it? The answer is obviously dependent on culture, at my current gig you just get brushed off Seems to me like you’re assuming that the economy incentivizes efficiency. Imo it doesn’t, it’s just a bunch of stupid rich people sloshing money around (for the most part). None of it makes any sense
- arvinsim 3y ago> Hypothetically, if she figured out how to automate it on her own, would she get any kind of reward for it? If not, why should she automate. The reward is more time. Now where that time is spent is another story.
- HHC-Hunter 3y agoSounds like you're implying that that newly spared time would be hers to spend and not her employers?
- eru 3y agoIf she keeps her mouth shut about it, definitely.
- TeMPOraL 3y agoOf course. She was presumably hired for regular office work, not R&D.
- dingi 3y agowhy not? she needs to be rewarded for that automation somehow.
- atoav 3y agoRealistically that reward is going to be: 1. more work 2. nice words and then more work 3. nice words, more work and then she is asked to do the same for another person's task who is then fired Sorry to be cynical here, but it is very rare for managment to reward the few people that do a better than good job with more free time or less work.
- throwaway14356 3y agoI use to point at office buildings and tell people non of the jobs there are real. They are all software that didn't get written. One logistics friend argued his well paid job was very important but with very little help he automated it in 2 weeks, it was just the idea never occurred to him. i told him to not tell anyone but he did and 300 people got fired
- mnky9800n 3y agoAnd don't forget that automating this process could also include a host of error checking she is simply unable to do because she is a human and not a computer.
- SanderNL 3y agoSomeone told me their job was mainly checking Word documents for discrepancies. Basically diffing them, but manually, by reading. I showed them how you could diff them automatically. This was not appreciated. “Cool, IT dude, now I lost my job.” And they were probably right if anybody cared enough to look at what they actually do.
- dingi 3y agoThat lady could have automated that with just a little glue code. Let the program do the work and use that time to do nothing. Nobody's complaining.
- delusional 3y ago>I helped a lady on Friday at a midsized bank whose job it was to take a set of dates in an Excel file, search each one individually into an internal search tool, then Ctrl+f the result report and verify that every code listed in the original document exists in the report. I happen to work in a midsized bank, and we have TONS of these sorts of manual processes. My favorite unintuitive fact is that 90% of them turn out to be some outdated compliance process that nobody remembered a person even did, and that is no longer necessary. That also usually the reason why something is "too small of an impact". Having 2 engineers come in to figure out that something is obviously just busywork, and then try to run some political process to convince leadership, is very expensive.
- deleted 3y ago[deleted]
- ethbr1 3y agoWhen I stumble across things like this, I always remember this scene from Babylon 5 (and Peter Jurasik's delivery!) (Context: they've found an attache and friend they thought was dead, alive but forgotten in a prison cell) https://m.youtube.com/watch?v=kCj-Rnd5SsA https://m.youtube.com/watch?v=kCj-Rnd5SsA
- leephillips 3y agoThat was pretty amazing. I have to watch this show some day.
- ethbr1 3y ago150% would recommend. I've watched it through 3 times over the years. Can't say that for any other show! If you do, commit to watching through the end of the second season, before you make a call. It takes that long for the show to find its feet and the overarching plot to get really going. And expect a lot of cheesy 90s stuff. Although way less than Star Trek! But on the whole, IMHO, it's incredibly modern and prescient for when it was released. Far fewer disconnected "monster/problem of the day" than e.g. X-Files, and even those usually still have character interactions that do important world building.
- dmvdoug 3y agoThere should be a Tell HN that is just an 800-comment-long thread full of these stories because I love them.
- npsimons 3y ago> There should be a Tell HN that is just an 800-comment-long thread full of these stories because I love them. As gratifying as they are, they get repetitive. Once you've heard one, you've heard them all. I'd much rather hear about the place that fixed a policy problem that was blocking such progress in the first place. Software is easy, getting people (and orgs) to change is hard, tedious, boring, but absolutely necessary, and more enduring than a lot of software fixes.
- dmvdoug 3y agoI believe that about repetitiveness. It’s just that I’m not in software or computers, so I haven’t been subject to them all. Although I was a lawyer, and I can tell you that human beings come up with an infinite variety of ways to do weird things, which gives me hope that there may be a weird software story out there for you, that you’ve never heard. :)
- JohnFen 3y agoI've been a dev for a very long time, and I still regularly hear weird software stories from colleagues that are not just "the same old thing" again. They're a pretty small percentage -- maybe 2-5%? -- but despite the low flow rate, the well never seems to actually empty.
- smokel 3y agoI agree that software is easy, and managing (human) processes is hard. Just the other day I advocated for a Free Management Foundation [1], in the same vein as the Free Software Foundation. Anyone care to spend their life on that? [1] https://news.ycombinator.com/item?id=37968979 https://news.ycombinator.com/item?id=37968979
- npsimons 3y ago> but I would say the decline has strictly been a failure of software. I would argue it's a failure of policy, and more specifically certain people enforcing a policy top-down on an industry they have little, if any, competence in. The tools are still out there, and those of us who know what we are doing balk at those managers (not programmers, BTW), telling us "you don't need that." We need to wrest control back from the managers, at all levels, and tell them to fuck off while we get real work done.
- crabbone 3y ago> set of dates in an Excel file PTSD intensifies
- baetylus 3y agoI've seen this before. My experience is that the leadership who approves improvements is too removed to care. This is one reason B2B SaaS generally targets decision makers.
- vore 3y agoThis article has absolutely nothing to do with what you’re saying. This article is about how certain types of calculations are better suited and are more efficient on specialized processors. I don’t know what finding dates in Excel has to do with this.
- pacificmaelstrm 3y agoPerhaps this is either: A: Where AI comes in to do this and then the rest of her job is well. B. Why programming should be taught as a basic subject in primary school.