3 ms·
If you don't need a skill, you won't practice it, and it will atrophy. This frees you to learn different things. Like how most software engineers today don't kn
by esafak 3y ago
If you don't need a skill, you won't practice it, and it will atrophy. This frees you to learn different things. Like how most software engineers today don't know computer engineering (hardware) but they can write more complex applications.
- SkyBelow 3y agoThat is if the AI fully replaces the need for a skill. What happens if it mostly replaces it, enough so the skill atrophies, but not enough that the user never needs the skill?
- esafak 3y agoGood point. That sounds like a temporary product problem, like a level 2-3 self-driving car, which still needs you to pay attention. I think you also need to consider whether you can afford not to have the skill; what would happen if the AI were taken away, or malfunctioned? Airplane pilots are an example of this. In that case you simply have to learn the skill as if the AI will not be there.
- hn_throwaway_99 3y ago> That sounds like a temporary product problem The jury is still out on how "temporary" of a problem that will be. Improvements have been made but nobody really knows how to get an LLM, for example, to just say "I don't know".
- Retric 3y agoAnd this is before people start poisoning the well. Google search worked better in a world without Google search. I suspect many AI systems will run into similar issues.
- hn_throwaway_99 3y ago> Google search worked better in a world without Google search. Oooh, I really like that. Very succinct and topical statement of Goodhart's Law.
- deleted 3y ago[deleted]
- taway_6PplYu5 3y agoOh, you mean like self-driving cars?
- vlovich123 3y agoDepends on what you mean by computer engineering but they should definitely have a good mental model of how computers work. Otherwise your complex applications will have trouble scaling. That can matter less in many cases but early architecture mistakes can easily put you down an evolutionary dead end forcing you to experience exponentially rising maintenance costs to add new features / fix bugs or rewrite the thing by someone who understands computer architecture better (+ take advantage of a better understanding the problem domain)
- WJW 3y agoI see what you mean but there's a huge gap between a "good enough" mental model of how computers work and the actual in-depth details that GP means and that have been successfully abstracted away from us. For example: the amount of cases when I have needed to know about the details of how the transistors in RAM chips are laid out have been extremely minimal. Nor have I ever had to worry about the encoding scheme used by the transceivers for the optical fibers that my TCP packets move across. Obviously there jobs out there that do have to worry about these things (mostly at companies like TSMC and Cisco), but in practice I doubt regular engineers at even the largest scale software companies have to worry about stuff like that.
- hn_throwaway_99 3y agoBut that is the exact problem with AI - 99% of the time it's good, so your skills atrophy, but then there's that one percent of the time it decides the reflective side of that 18-wheeler is the sun and drives you into it. That's very different from, say, a compiler, which as a programmer I completely trust to turn my source code into machine code accurately.
- tikhonj 3y ago> completely trust to turn my source code into machine code accurately Say hello to undefined behavior :) Appropriately enough, much of the reason undefined behavior is a consistent problem is exactly the same—it can do something reasonable 99% of the time and then totally screw you over out of nowhere.
- Jensson 3y agoUndefined behavior is a defined thing, you know about it so you can avoid it if you want, or look up what the compiler you use does in that case to see if it is useful to you. No such thing for a black box AI model.
- BeetleB 3y agoYou're just mirroring the parent example. Prior to AI (or even computers), this was a problem. I used to be a more conventional engineering guy. We do a ton of calculus to get our degree. My first job - you just didn't need calculus (although all the associated courses in school used it to develop the theory). As a result, the one offs (less than once a year), when a problem did come up where calculus knowledge was helpful, they couldn't do the task and would go to that one guy (me) who still remembered calculus. BTW, I guarantee all the employees there got A's on their calculus courses.
- hn_throwaway_99 3y ago> You're just mirroring the parent example. Prior to AI (or even computers), this was a problem. Not at all, and your argument isn't the same thing. The problem with current AI, which is very different from past forms of automation, is that, essentially, its failure mode is undefined. Past forms of automation, for example, did not "hallucinate" seemingly correct but false answers. Even taking your own example, it was obvious to your colleagues that they didn't know how to get the answer. So they did the correct thing - they went to someone who knew how to do it. What they did not do, and which is what most current AI solutions will do, is just "wing it" with a solution that is wrong but looks correct to those without more expertise.
- warner25 3y agoThis a nice, tight statement of the big picture. This isn't new, like since LLMs were born, either. In the aviation community, and probably many other domains, there has been a running debate for decades about the pros and cons of introducing more automation into the cockpit and what still should or shouldn't be taught and practiced in training (to be able to effectively recognize and handle the edge cases where things fail). And in military aviation, this isn't just a question of safety; it's about productivity just like it is for knowledge workers. If an aircraft can fly itself most of the time, the crew can do more tactical decision-making and use more sensors and weapons. Instead of just flying their own aircraft, the crew can also control a number of unmanned aircraft with which they're teamed up.