3 ms·
> why technologists don't think about the consequences of what they do before they do it? “Prediction is very difficult, especially about the future.” ― Niels
by ben_w 3y ago
> why technologists don't think about the consequences of what they do before they do it?
“Prediction is very difficult, especially about the future.” ― Niels Bohr
More pertinently, people have been arguing over the consequences of increasingly performant automation at least since Ada Lovelace was thinking about using something like the Difference Engine for music and Joseph Marie Jacquard was using punched cards for complex weaving.
The 200 years between them and us has given us radical, and for most people incomprehensible, growth. Back then, famine was common even with 90-95% of the population working in agriculture; now, obesity is the bigger problem with 1-5% of the population working in agriculture.
We knew about CO2 being a greenhouse gas a century ago, but we thought it would take a millennium and be a good thing; CFCs were chosen as a refrigerant because they were un-reactive; cars were a solution to all the horse manure on the streets; asbestos the solution to all the fires; radium paint was used on watch dials, nuclear explosives were seriously suggested as a way to widen (and also separately to replace) the Panama Canal.
It's just really hard to see all the consequences of things, even with the best will in the world — not that this completely contradicts what you say, as there's also the other famous quote:
“It is difficult to get a man to understand something, when his salary depends on his not understanding it.” ― Upton Sinclair
- b112 3y agoA note. There is a sensible reason why, likely evolutionary derived, that we ignore "in the future" things so handily. Social reasons. Let's presume I dislike my neighbour. He's not loud, just an asshat or some such, to the point that I'd love to punch him in the head. I don't, of course. We live in a modern society. Nor does he, either! The dislike flows mutual, deep and dark, yet we essentially ignore each other. And even more astonishing? We go to sleep each night with a rival next door, sleep peacefully and in comfort, yet each of us with baser, animialistic instincts to beat on each other, perhaps to death, and yet? Even more astonishing, if the city walls were attacked? Hatred or not, we'd stand back to back and defend each other. Our families. Our friends, our city. We are genetically predispositioned to live beside danger, and even completely ignore it, put it out of the way. The danger with the neighbour, a rival!! right next door, is ignored. And more so, the danger with those invaders one city over, with the wolf outside our cabin door, all of these things are put out of mind. We'd go bananas if we had to focus on "the threat" constantly. So we are designed to ignore even impending threats, let alone threads "decades or more in the future". If fact, I've often wondered if the more dire and dangerous the threat, yet with it not immediately on our doorstep, the more people might simply block it out! That only mild threats are something that average human can deal with, for there is no need to push it from mind to sleep, to relax, to live without becoming a bundle of nerves. I wonder if there's some metric here, some "perfect level of threat", which ensures it is constantly in mind, yet sleep is possible, this returning the maximum human action on a distant (time or distance) threat.
- palata 3y agoAll very good points! I guess my frustration is that I can understand how fighting famine brought immediate, crucial benefits (even though it seems likely that the technological improvements that improved life may soon destroy civilization as we know it). But the very first ideas that got in my mind where I learned about LLMs were black hat oriented. I actually needed to make an effort to see the potential benefits of LLMs (other than translators), but I immediately had many ideas of how that could go wrong (probably all of them being mentioned in the featured article). In the case of LLMs, it seems a lot more direct than, say, the famous story of the Facebook "likes", that did sound like a good idea at first. LLMs sound like a bad idea (for society) from the beginning on.
- ben_w 3y ago> But the very first ideas that got in my mind where I learned about LLMs were black hat oriented. I actually needed to make an effort to see the potential benefits of LLMs (other than translators), but I immediately had many ideas of how that could go wrong (probably all of them being mentioned in the featured article). I'm pleasantly surprised to learn this. My experiences here since ChatGPT was launched have generally involved witnessing many of the louder people opining that LLMs "cannot" cause harm and that any example of harm anyone gives is "only" free speech. (The latter is something I find inherently weird as a talking point, given how important speech is). I hope you're working in some kind of AI safety role; myself, I could only recognise the flaws when others showed them to me, I was not able to figure out these problems in advance.