6 ms·

Ask HN: How worried are you about being replaced by an LLM

18 points by upmind 3y ago

LLMs today won't be able to replace most engineers (I hope), but how worried are you of getting replaced 10-15 years down the line?

tobinfekkes 3y ago
Not in the slightest. Generating a snippet, or even entire blocks, of code is not a good metric on which to base the quality of LLMs. Rather, we should pay attention to how good is an LLM at altering, editing, maintaining code? In practice, it's quite poor. And not in the way that a new developer is poor, but in weird and uncertain and unpredictable ways, or in ways that it fixed in the last prompt but broke in the new prompt. Engineers spend little time writing code compared to the amount of time they spend thinking and designing and buildings systems for that code to operate in. LLMs are terrible at systems. "Systems" implies layers, and layers implies constraints, and constraints implies specificity, and specificity is not a strong suit of an LLM. The systems in which most code is written is not written once and never touched again. Instead, it passes through many layers (automated and manual) to reach some arbitrary level of correctness across many vectors, in many contexts, some digital and some not. LLMs are passable at solving problems of one, maybe two, layers of complexity as long as all the context is digitized first. Lastly, not all problems have a technical solution. In fact, creating a technical solution for a non-technical problem so that we can apply an LLM to it will only cause layers of unnecessary abstraction that locks out "normal" people from participating in the solution. And we may not like to admit it, but we engineers often have work to do for a job we like for pay that's pretty good, only because there are a whole lot of non-programmers out there solving the non-technical problems that we don't want to do.
- crudcodersare 3y ago
  Clearly, you have your nose stuck in the past. LLMs aren't just good; they're revolutionary, making coders look like one finger keyboard peckers. They're not struggling with maintaining systems; they can be trained on specific datasets and codebases, totally mastering them in ways no human can ever hope to do, making your traditional coding seem like manual typewriting and laughable in comparison. The idea that they can't handle specificity is also laughable. LLMs are not the future; they're the now, effortlessly bridging tech and non-tech worlds, totally replacing programmers. Anyone thinking otherwise is simply not paying attention. The writing is on the wall.
  - randysalami 3y ago
    Can I ask how you’re accomplishing this? What tools and workflows are you using to have LLMs actually do this level of development in the present? Sounds like you are at the cutting edge and I’m very curious since I still hear copilot being touted as “cutting edge”. Thanks!
  - lurking_swe 3y ago
    this sounds like something an LMM wrote lol. Answer me this: often times even my product manager doesn’t know WHAT they want. They think they know but they don’t really, once you start looking at the code, there are dozens of edge cases throughout the system. The requirements are vague. How do you expect an LLM to magically figure that out? Or more importantly, the business domain (a domain not easily trained on textbooks or crap found on the internet)? And I don’t have my head stuck in the sand. I’ve found LLM’s great for brainstorming, implementing small functions, or updating snippets of configuration like terraform.
deleted 3y ago
[deleted]
endisneigh 3y ago
Not at all. I do worry though that people will not try as much to learn fundamentals. I’m certainly somewhat guilty of this being in the Search-era, I fear it’ll be easier to succumb to it in the AI-era.
aynyc 3y ago
I don’t worry about being replaced. I worry about fixing all the crappy code generated by LLMs in 10-25 years time.
- austin-cheney 3y ago
  This. Most people hired to write JavaScript are pretenders that cannot write JavaScript. At some point employers will just use AI to generate equally bad code at far lower cost. I dread the web being even more flooded with bad framework code than it already is. The people that worry most about being replaced by AI probably should be, the people who cry about reinventing the wheel and cannot write original code, but most everyone else will be just fine.
- dakiol 3y ago
  Why? I mean, if crappy code is so crappy that even LLMs cannot fix, then I imagine it will pay well. I'm in!
al_borland 3y ago
Not too worried. The direction I get is not nearly enough to create anything that works with an LLM. I get told “make X”, and any questions I have are ignored or can’t be answered by the person making the request. I end up making hundreds of design choices along the way that an LLM isn’t going to make. It’s just going to spit out a garbage result based on the garbage input. I don’t ever see an LLM having enough information about the internal workings of my company, the unspoken wants and needs of the company, and feeling the need to recognize and compensate for the astounding lack of information to avoid an angry boss.
- crudcodersare 3y ago
  Oh, al_borland, living in a delightful bubble where you think your design choices are immune to the AI revolution. "Garbage in, garbage out"? Please. LLMs are learning to sift through the trash, making sense of vague directions to produce not just code, but coherent, innovative solutions. Your hundreds of decisions? LLMs are on track to replicate that intuition, tapping into patterns and precedents you're unaware exist. The unspoken wants and needs of your company? AI's pattern recognition is becoming uncannily perceptive trained on specific company datasets, codebases, domain knowledge, real time metrics in ways you never will be able to do.
  - al_borland 3y ago
    A lot of that depends on the company and their ability to execute on these things. At my company, I’m not too worried in the near term. Thinking 10-15 years out, I still don’t know if I’m all that worried, when I look at what progress has looked like over the last 15 years. A lot of people are wearing rose colored glasses right now when it comes to AI. It will take time to see how much of that optimism is valid and how much is misplaced. This isn’t the first technology to come along that people thought was a silver bullet to solve all the world’s problems. Over time, as the market matures, the glasses will come off and we’ll see where we end up. AI is a tool, and will be really good for some things, but won’t be the right tool for every job. There will also be various levels of autonomy giving to it, depending on the use. It’s also worth remembering that there are a broad range of businesses out there are varying levels of technical maturity. Just because some companies figure out how to do some cool stuff with AI doesn’t mean all companies will be doing it at that same level. There are still many companies that barely have a web presence, 25-30 years after the internet went mainstream, while other companies exist solely online. I have no doubt I’ll see professions disappear in my lifetime, while new ones are born. If I need to adapt, I’ll adapt.
vasili111 3y ago
Not worried. LLMs are just another tool that you can use to be more productive. How often and to what extent you will use LLMs differ from person to person. I think LLMs can help you but not replace you.
gngoo 3y ago
0% worried about anything that automates things replacing my development and engineering skills within my lifetime. Or impact my livelihood.
scaredOfAI 3y ago
Very worried. The BLS edited their stats, projecting the number of software engineers will decrease by 11% in the next ten years: https://www.bls.gov/ooh/computer-and-information-technology/computer-programmers.htm https://www.bls.gov/ooh/computer-and-information-technology/... This is a pretty drastic change from their earlier prediction (often cited all over the internet) that the number of software engineers will increase by more than 30% in the next 10 years. It's not the full replacement of software engineers I'm worried about, so much as the steep reduction in the number of jobs and the labor/wage pressure that will make this job pay a fraction of what it's paying now, and make everyone's livelihoods more precarious in the next 10 to 15 years. Karpathy already stated in 2017 that "Gradient Descent writes better code than you", when he wrote about "Software 2.0" as feeding data to neural networks: https://karpathy.medium.com/software-2-0-a64152b37c35 https://karpathy.medium.com/software-2-0-a64152b37c35 Nvidia's CEO, Jensen Huang, seemed to have confirmed that point this week in persuading parents not to encourage their kids to learn to code. Today, this YT video by a dev named Will Iverson about how software engineering jobs are not coming back made me really anxious, and start to worry about making backup career plans in case I need to transition in my late thirties / early forties. (That sounds sooo hard...I'm a recently laid off mid-level full stack engineer of seven years, but I wonder if it would be better to transition now while I'm younger. Why wait 10 to 15 years to become increasingly obsolete or more stressed of becoming laid off? How can I support a family like that? Or make any plans into the future that might impact other people I'm responsible for?) https://www.youtube.com/watch?v=6JX5ZO19hiE&t=3s https://www.youtube.com/watch?v=6JX5ZO19hiE&t=3s I don't think the industry will ever really be the same again. But I'm sure a lot of us will adapt. Some of us won't, and will probably have to switch careers. I always thought I could at least make it to retirement in this profession, by continually learning a few new skills each year as new tech frameworks emerge but the fundamentals stay the same -- now I'm not so sure. If you think I'm wrong, can you please help me not be anxious? Older devs, how have you managed to ride out all the changes in the industry over the last few decades? Does this wave of AI innovations feel different than earlier boom-bust cycles like the DotCom Bubble, or more of the same? What advice would you give to junior or mid-level software engineers, or college grads trying to break into the industry right now, who have been failing completely at getting a foot in the door in the last 12 months, when they would have been considered good hires just two or three years before?
sircastor 3y ago
I just tried to build a c program for an Arduino to display some text on a screen. It needed a lot of work to get it to work. That’s not to say that it couldn’t have been coerced into being right through prompts, but it’s a reminder that LLMs are not thinking. You still need someone who understands not only what is wanted, but why it looks the way it does. I suspect that most of this stuff will end up like syntactic sugar: Something that makes our work easier, but not fundamentally replace us.
barronli 3y ago
The labor replacement is happening in the whole human history, but I am not worried, not because I don't believe LLM's capabilities in 10-15 years, but because I believe I can always find some areas where LLM is not good at.
parentheses 3y ago
I am. I think with enough scale and more organized and structured use of them, they (or another soon-to-come AI breakthrough) will outdo a human mind.
petabyt 3y ago
The only thing that I worry about is the horrible things people will use AI for.
kasperlitheater 3y ago
I'm more worried about the web becoming unusable due to AI/ML spam. Already now there is a huge amount of LLM generated bullshit content in the web and it will only get worse. And then other LLM's might train on that BS.
- haliyat 3y ago
  +1. I also am increasingly thinking that this generation of AI is going to destroy social media with a flood of what Cory Doctorow calls “botshit”. Only difference is instead of worried about this I’m more <Jack Nicholson head-nodding meme>. The death of social media can’t come too soon.
- crudcodersare 3y ago
  Yes, there will be spam, as there always has been—let's not forget the golden age of email, where every click was a foray into the unknown. But here's where it gets interesting: as the floodgates open and the digital detritus begins to pile up, so too does the ingenuity of human and AI collaboration in crafting ever more sophisticated filters, verifiers, and sifters. We're not just talking about a simple spam filter here; we're envisioning a grand symphony of algorithmic alchemy capable of separating wheat from chaff with the precision of a diamond cutter. but diving into the deep end of digital dismay, are we? Let's unravel this tapestry of concern with a flamboyantly convoluted rebuttal that dances around the maypole of AI evolution and internet content proliferation. Picture, if you will, a burgeoning digital universe, already teeming with a veritable smorgasbord of information, misinformation, and everything in between. Into this chaotic jamboree steps the latest parade of performers: the LLMs, with their glittering capes of algorithmic complexity, ready to churn out content with the prolificacy of a cosmic bakery on overdrive. Now, the fear you've articulated, draped in the elegant garb of concern for our collective digital sanity, presupposes a dystopian future where the internet becomes a vast ocean of AI-generated flotsam and jetsam. But let's twirl that narrative on its head, shall we? Imagine, instead, a world where these AI entities, far from being the harbingers of informational apocalypse, become the architects of a new informational renaissance. And let's not underestimate the serendipitous creativity that emerges from this chaotic cauldron of content. For every thousand pieces of nonsense, there might emerge an idea, a concept, a piece of art that could only have been born in such a fertile environment of unbridled creation. As for the concern about LLMs training on, shall we say, less than stellar sources of information, consider this: evolution is not a straight line but a meandering path through the forests of failure and the mountains of success. Just as humans learn from mistakes, so too will our AI counterparts, sifting through the sediment of digital discourse to find the nuggets of truth and innovation. Ok an internet rendered unusable by AI-generated content are not without foundation, they fail to account for the boundless capacity for adaptation and innovation that characterizes both human and artificial intelligence. So, rather than wringing our hands in despair at the prospect of navigating an ever-more cluttered digital landscape, let us roll up our sleeves and dive into the fray, armed with the knowledge that in chaos lies opportunity, in spam lies the seed of sophistication, and in the vast, uncharted territories of the internet lies the next great frontier of human achievement.
codingdave 3y ago
Not one bit. Writing code isn't my job, it is just the tool I use to do my job. The actual job is to provide systems that solve problems. Even if a new tool comes along that can write the code, it does not change my job.
- crudcodersare 3y ago
  Oh, holding onto your job description like a security blanket, huh? Wake up! LLMs are storming the castle, not just to play with your coding tools, but to usurp your throne of problem-solving. Your 'actual job'? About to be a footnote in the saga of AI's conquest. Dismissing LLMs is like challenging a tidal wave with a teaspoon. Adapt or become a quaint anecdote in the chronicles of tech evolution.
mfalcon 3y ago
Not worried, I am confident that I will always find a way to provide value.
dakiol 3y ago
I don't think that's gonna happen... unless I don't keep learning. Let me explain: I started my career over a decade ago. I knew PHP and MySQL only. Then I moved onto other companies, learnt other stacks (frontend, node, postgres, cloud, go, python, datadog, ci/cd, docker, k8s, aws, etc.). Nowadays it's not hard for me to find a new job. But what would have happened if I stayed with PHP and MySQL and never learnt anything else? I would be jobless. So, I'm not afraid of LLMs replacing me. I think they will open the door to more jobs in IT, actually. I just need to keep learning (and AI has nothing to do with this).
- crudcodersare 3y ago
  Honestly, thinking you can outpace LLMs with your learning curve is like believing you can outrun a tsunami on a bicycle. Your decade of tech evolution? LLMs do that before breakfast, without the coffee break. The truth is harsh—LLMs are on track to render programmers obsolete, turning your diversified skill set into a quaint relic. Face it, we're not just talking job replacement; we're heralding a new era where coding is an AI's game.
  - haliyat 3y ago
    You sound more like an out of touch executive or a recently-converted-Bitcoin-scammer than someone doing real work with this stuff (and yes I saw your top-voted post — as someone who also works in games at a large AAA studio I’ll just say I look forward to the GDC talk showing the evidence).
p1esk 3y ago
You are naive if you think you have 10-15 years. GPT-5 will most likely be out by the end of the year. It will be significantly better than GPT-4. I expect it will replace millions of people - not explicitly - companies will gradually have fewer people doing more work, resulting in increasing layoffs and decreasing hiring. This has already started happening: I spoke to several startup founders recently who use GPT-4 instead of hiring marketing people. GPT-5 will be significantly better at coding, to the point where it might no longer make any sense to hire junior developers. And this is just GPT-5, this year. Next year there will be GPT-6, or an equivalent from Google or Anthropic, and at that point I fully expect a lot of people everywhere getting the boot. Sometime next year I expect these powerful models will start effectively controlling robots, and that will start the process of automation of a lot of physical work. So, to summarize, you have at best 2 years left as a software engineer. After that we can hope there will be some new types of professions that we could pivot to, but I’m struggling to think what could people possibly do better than GPT-6, so I’m not optimistic. I’d love for someone to provide a convincing argument why there would be any delay to the timeline I outlined above. p.s. I just looked at the other 20 responses in this thread, and it seems that every single one is based on current (GPT-4) LLM capabilities. Do people seriously not see any progress happening in the nearest future? Why? I’m utterly baffled by this.
- findingMeaning 3y ago
  > Why? I’m utterly baffled by this. Yes, me too! I am surprised people are unaware of the empirical power-scale law. [1] Currently, Anthropic's new model has proven it by being better than GPT-4 on some tasks. Yet, the old people are saying it is okay. They are saying engineering is not just coding. What they don't seem to grasp is there won't be a necessity for as many engineers. If people are not willing to accept juniors, where will the next generation of seniors come from? No clue about that. Probably, that spot is reserved for the brilliant minds graduating from R1 institutes. What about the average Joe? Not everyone has the fortune to work on very specialized domain skills. People just don't get it easily. Everyone in academia has admitted to productivity boost by 30-40%. And here we are talking about hard research. Imagine, what it looks for regular job which is managing and maintaining codebases. The severity of this situation is truly alarming not for the greybeards but for us, Zoomers. With climate crisis, AI, geopolitical instability, it feels really great to be alive. [1]: https://arxiv.org/abs/2001.08361 https://arxiv.org/abs/2001.08361
haliyat 3y ago
I’m not at all worried about LLMs replacing even low-level engineers. We’ve been using Copilot and ChatGPT for awhile at work now and the most useful applications we’ve found are more analogous to a compiler than a developer. For example, we’ve had good luck using it to help port a bunch of code between large APIs. the process still involves a lot of human work to fix bugs from its output but a project we estimated at 6 months took three weeks. On the other hand, as someone whose role gives me visibility into the way senior leaders at the company think about what AI will be able to do, I’m absolutely terrified that they’re going to detonate the company by massively over-investing in AI before it’s proven and by forcing everyone to distort their roadmaps around some truly unhinged claims about what AI is going to do in the future. CEOs and senior corporate leaders don’t understand what this technology is and have always dreamed of a world where they didn’t need engineers (or anyone else who actually knows how to make stuff) but instead could turn the whole company into a big “Done” button that just pops out real versions of their buzzword filled fever dreams. This makes them the worst possible rubes for some the AI over-promising — and eager to make up their own! Between this and the really crazy over-valuations we’re already seeing in companies like Nvidia, I’m seeing the risk of a truly catastrophic 2000- or 2008-style economic crash rising rapidly and am starting to prepare myself for that scenario in the next 2-5 years.
crudcodersare 3y ago
Yeah the writing is on the wall. I'm a senior AI programmer for an AAA games studio that you probably know (I worked on a very famous RTS game). I have reduced the code I write by about 90% since ChatGPT 4 was released. My colleagues have also reduced their coding time similiarly. This technology is going to remove all the toil and any need to hire/communicate with junior devs. I imagine it will be the same for other seniors in the programming community. An industry where it's just seniors and LLMs within 4 years is likely, if not sooner, 2 years tbh, and if this slowly transitions to just LLMs and a small team of code reviewers on each site, that would be ideal. Programmers in my area (AI) have a lot of domain knowledge and specialization, we just use code for implementation. So we don't care if LLMs replace coders by auto generating code. All the better for us. The people who are trying to support families ... by offering the world to write CRUD or maintaining codebases are doomed.... they are going to end up as the homeless guy on the street holding a sign saying "will code html for food"
- oumua_don17 3y ago
  >> Programmers in my area (AI) have a lot of domain knowledge and specialization How long do you think then when LLM's gain this as well? And then?
Ekaros 3y ago
Not too much. Mostly doing security work and lot of can be automated, but still I don't believe LLMs have all the ideas. Same goes for system design and picking the right parts, even if they are ready or can be done by LLM. In the end we need humans as final sanity check or over all design for good while. Or just to decide the right requirements.
aristofun 3y ago
The less experienced you are and less mature as a software engineer — the more fearful. You can literally estimate the proficiency and experience level here in comments. People that have seen some serious sh*t probably won't even bother answering the question.
colund 3y ago
While I agree that LLMs can be useful for coders, and productivity can be increased, coding blindly based on ChatGPT code without understanding concepts could result in very serious bugs. How can you be sure that the code does not have vulnerabilities for example, or solve things in a non-idiomatic way, if you just copy paste code without an understanding. As long as an understanding of the domain and problem is required a skilled person is required between the codebase and the LLM. Even if we get to a point in the future where a programmer can be replaced by an LLM, we'll have businesses where they want someone to use the LLMs to create software.
adawg4 3y ago
Pair programming with AI already is great. I fear if it weeds out experts and people implement AI versions of themselves as offshoot. Seems far away given depth of business logic/available data in those limited spots
deleted 3y ago
[deleted]

18 points by upmind 3y ago

LLMs today won't be able to replace most engineers (I hope), but how worried are you of getting replaced 10-15 years down the line?

tobinfekkes 3y ago

Not in the slightest. Generating a snippet, or even entire blocks, of code is not a good metric on which to base the quality of LLMs. Rather, we should pay attention to how good is an LLM at altering, editing, maintaining code? In practice, it's quite poor. And not in the way that a new developer is poor, but in weird and uncertain and unpredictable ways, or in ways that it fixed in the last prompt but broke in the new prompt. Engineers spend little time writing code compared to the amount of time they spend thinking and designing and buildings systems for that code to operate in. LLMs are terrible at systems. "Systems" implies layers, and layers implies constraints, and constraints implies specificity, and specificity is not a strong suit of an LLM. The systems in which most code is written is not written once and never touched again. Instead, it passes through many layers (automated and manual) to reach some arbitrary level of correctness across many vectors, in many contexts, some digital and some not. LLMs are passable at solving problems of one, maybe two, layers of complexity as long as all the context is digitized first. Lastly, not all problems have a technical solution. In fact, creating a technical solution for a non-technical problem so that we can apply an LLM to it will only cause layers of unnecessary abstraction that locks out "normal" people from participating in the solution. And we may not like to admit it, but we engineers often have work to do for a job we like for pay that's pretty good, only because there are a whole lot of non-programmers out there solving the non-technical problems that we don't want to do.

crudcodersare 3y ago
Clearly, you have your nose stuck in the past. LLMs aren't just good; they're revolutionary, making coders look like one finger keyboard peckers. They're not struggling with maintaining systems; they can be trained on specific datasets and codebases, totally mastering them in ways no human can ever hope to do, making your traditional coding seem like manual typewriting and laughable in comparison. The idea that they can't handle specificity is also laughable. LLMs are not the future; they're the now, effortlessly bridging tech and non-tech worlds, totally replacing programmers. Anyone thinking otherwise is simply not paying attention. The writing is on the wall.
- randysalami 3y ago
  Can I ask how you’re accomplishing this? What tools and workflows are you using to have LLMs actually do this level of development in the present? Sounds like you are at the cutting edge and I’m very curious since I still hear copilot being touted as “cutting edge”. Thanks!
- lurking_swe 3y ago
  this sounds like something an LMM wrote lol. Answer me this: often times even my product manager doesn’t know WHAT they want. They think they know but they don’t really, once you start looking at the code, there are dozens of edge cases throughout the system. The requirements are vague. How do you expect an LLM to magically figure that out? Or more importantly, the business domain (a domain not easily trained on textbooks or crap found on the internet)? And I don’t have my head stuck in the sand. I’ve found LLM’s great for brainstorming, implementing small functions, or updating snippets of configuration like terraform.

deleted 3y ago

[deleted]

endisneigh 3y ago

Not at all. I do worry though that people will not try as much to learn fundamentals. I’m certainly somewhat guilty of this being in the Search-era, I fear it’ll be easier to succumb to it in the AI-era.

aynyc 3y ago

I don’t worry about being replaced. I worry about fixing all the crappy code generated by LLMs in 10-25 years time.

austin-cheney 3y ago
This. Most people hired to write JavaScript are pretenders that cannot write JavaScript. At some point employers will just use AI to generate equally bad code at far lower cost. I dread the web being even more flooded with bad framework code than it already is. The people that worry most about being replaced by AI probably should be, the people who cry about reinventing the wheel and cannot write original code, but most everyone else will be just fine.
dakiol 3y ago
Why? I mean, if crappy code is so crappy that even LLMs cannot fix, then I imagine it will pay well. I'm in!

al_borland 3y ago

Not too worried. The direction I get is not nearly enough to create anything that works with an LLM. I get told “make X”, and any questions I have are ignored or can’t be answered by the person making the request. I end up making hundreds of design choices along the way that an LLM isn’t going to make. It’s just going to spit out a garbage result based on the garbage input. I don’t ever see an LLM having enough information about the internal workings of my company, the unspoken wants and needs of the company, and feeling the need to recognize and compensate for the astounding lack of information to avoid an angry boss.

crudcodersare 3y ago
Oh, al_borland, living in a delightful bubble where you think your design choices are immune to the AI revolution. "Garbage in, garbage out"? Please. LLMs are learning to sift through the trash, making sense of vague directions to produce not just code, but coherent, innovative solutions. Your hundreds of decisions? LLMs are on track to replicate that intuition, tapping into patterns and precedents you're unaware exist. The unspoken wants and needs of your company? AI's pattern recognition is becoming uncannily perceptive trained on specific company datasets, codebases, domain knowledge, real time metrics in ways you never will be able to do.
- al_borland 3y ago
  A lot of that depends on the company and their ability to execute on these things. At my company, I’m not too worried in the near term. Thinking 10-15 years out, I still don’t know if I’m all that worried, when I look at what progress has looked like over the last 15 years. A lot of people are wearing rose colored glasses right now when it comes to AI. It will take time to see how much of that optimism is valid and how much is misplaced. This isn’t the first technology to come along that people thought was a silver bullet to solve all the world’s problems. Over time, as the market matures, the glasses will come off and we’ll see where we end up. AI is a tool, and will be really good for some things, but won’t be the right tool for every job. There will also be various levels of autonomy giving to it, depending on the use. It’s also worth remembering that there are a broad range of businesses out there are varying levels of technical maturity. Just because some companies figure out how to do some cool stuff with AI doesn’t mean all companies will be doing it at that same level. There are still many companies that barely have a web presence, 25-30 years after the internet went mainstream, while other companies exist solely online. I have no doubt I’ll see professions disappear in my lifetime, while new ones are born. If I need to adapt, I’ll adapt.

vasili111 3y ago

Not worried. LLMs are just another tool that you can use to be more productive. How often and to what extent you will use LLMs differ from person to person. I think LLMs can help you but not replace you.

gngoo 3y ago

0% worried about anything that automates things replacing my development and engineering skills within my lifetime. Or impact my livelihood.

scaredOfAI 3y ago

Very worried. The BLS edited their stats, projecting the number of software engineers will decrease by 11% in the next ten years: https://www.bls.gov/ooh/computer-and-information-technology/computer-programmers.htm https://www.bls.gov/ooh/computer-and-information-technology/... This is a pretty drastic change from their earlier prediction (often cited all over the internet) that the number of software engineers will increase by more than 30% in the next 10 years. It's not the full replacement of software engineers I'm worried about, so much as the steep reduction in the number of jobs and the labor/wage pressure that will make this job pay a fraction of what it's paying now, and make everyone's livelihoods more precarious in the next 10 to 15 years. Karpathy already stated in 2017 that "Gradient Descent writes better code than you", when he wrote about "Software 2.0" as feeding data to neural networks: https://karpathy.medium.com/software-2-0-a64152b37c35 https://karpathy.medium.com/software-2-0-a64152b37c35 Nvidia's CEO, Jensen Huang, seemed to have confirmed that point this week in persuading parents not to encourage their kids to learn to code. Today, this YT video by a dev named Will Iverson about how software engineering jobs are not coming back made me really anxious, and start to worry about making backup career plans in case I need to transition in my late thirties / early forties. (That sounds sooo hard...I'm a recently laid off mid-level full stack engineer of seven years, but I wonder if it would be better to transition now while I'm younger. Why wait 10 to 15 years to become increasingly obsolete or more stressed of becoming laid off? How can I support a family like that? Or make any plans into the future that might impact other people I'm responsible for?) https://www.youtube.com/watch?v=6JX5ZO19hiE&t=3s https://www.youtube.com/watch?v=6JX5ZO19hiE&t=3s I don't think the industry will ever really be the same again. But I'm sure a lot of us will adapt. Some of us won't, and will probably have to switch careers. I always thought I could at least make it to retirement in this profession, by continually learning a few new skills each year as new tech frameworks emerge but the fundamentals stay the same -- now I'm not so sure. If you think I'm wrong, can you please help me not be anxious? Older devs, how have you managed to ride out all the changes in the industry over the last few decades? Does this wave of AI innovations feel different than earlier boom-bust cycles like the DotCom Bubble, or more of the same? What advice would you give to junior or mid-level software engineers, or college grads trying to break into the industry right now, who have been failing completely at getting a foot in the door in the last 12 months, when they would have been considered good hires just two or three years before?

sircastor 3y ago

I just tried to build a c program for an Arduino to display some text on a screen. It needed a lot of work to get it to work. That’s not to say that it couldn’t have been coerced into being right through prompts, but it’s a reminder that LLMs are not thinking. You still need someone who understands not only what is wanted, but why it looks the way it does. I suspect that most of this stuff will end up like syntactic sugar: Something that makes our work easier, but not fundamentally replace us.

barronli 3y ago

The labor replacement is happening in the whole human history, but I am not worried, not because I don't believe LLM's capabilities in 10-15 years, but because I believe I can always find some areas where LLM is not good at.

parentheses 3y ago

I am. I think with enough scale and more organized and structured use of them, they (or another soon-to-come AI breakthrough) will outdo a human mind.

petabyt 3y ago

The only thing that I worry about is the horrible things people will use AI for.

kasperlitheater 3y ago

I'm more worried about the web becoming unusable due to AI/ML spam. Already now there is a huge amount of LLM generated bullshit content in the web and it will only get worse. And then other LLM's might train on that BS.

haliyat 3y ago
+1. I also am increasingly thinking that this generation of AI is going to destroy social media with a flood of what Cory Doctorow calls “botshit”. Only difference is instead of worried about this I’m more <Jack Nicholson head-nodding meme>. The death of social media can’t come too soon.
crudcodersare 3y ago
Yes, there will be spam, as there always has been—let's not forget the golden age of email, where every click was a foray into the unknown. But here's where it gets interesting: as the floodgates open and the digital detritus begins to pile up, so too does the ingenuity of human and AI collaboration in crafting ever more sophisticated filters, verifiers, and sifters. We're not just talking about a simple spam filter here; we're envisioning a grand symphony of algorithmic alchemy capable of separating wheat from chaff with the precision of a diamond cutter. but diving into the deep end of digital dismay, are we? Let's unravel this tapestry of concern with a flamboyantly convoluted rebuttal that dances around the maypole of AI evolution and internet content proliferation. Picture, if you will, a burgeoning digital universe, already teeming with a veritable smorgasbord of information, misinformation, and everything in between. Into this chaotic jamboree steps the latest parade of performers: the LLMs, with their glittering capes of algorithmic complexity, ready to churn out content with the prolificacy of a cosmic bakery on overdrive. Now, the fear you've articulated, draped in the elegant garb of concern for our collective digital sanity, presupposes a dystopian future where the internet becomes a vast ocean of AI-generated flotsam and jetsam. But let's twirl that narrative on its head, shall we? Imagine, instead, a world where these AI entities, far from being the harbingers of informational apocalypse, become the architects of a new informational renaissance. And let's not underestimate the serendipitous creativity that emerges from this chaotic cauldron of content. For every thousand pieces of nonsense, there might emerge an idea, a concept, a piece of art that could only have been born in such a fertile environment of unbridled creation. As for the concern about LLMs training on, shall we say, less than stellar sources of information, consider this: evolution is not a straight line but a meandering path through the forests of failure and the mountains of success. Just as humans learn from mistakes, so too will our AI counterparts, sifting through the sediment of digital discourse to find the nuggets of truth and innovation. Ok an internet rendered unusable by AI-generated content are not without foundation, they fail to account for the boundless capacity for adaptation and innovation that characterizes both human and artificial intelligence. So, rather than wringing our hands in despair at the prospect of navigating an ever-more cluttered digital landscape, let us roll up our sleeves and dive into the fray, armed with the knowledge that in chaos lies opportunity, in spam lies the seed of sophistication, and in the vast, uncharted territories of the internet lies the next great frontier of human achievement.

codingdave 3y ago

Not one bit. Writing code isn't my job, it is just the tool I use to do my job. The actual job is to provide systems that solve problems. Even if a new tool comes along that can write the code, it does not change my job.

crudcodersare 3y ago
Oh, holding onto your job description like a security blanket, huh? Wake up! LLMs are storming the castle, not just to play with your coding tools, but to usurp your throne of problem-solving. Your 'actual job'? About to be a footnote in the saga of AI's conquest. Dismissing LLMs is like challenging a tidal wave with a teaspoon. Adapt or become a quaint anecdote in the chronicles of tech evolution.

mfalcon 3y ago

Not worried, I am confident that I will always find a way to provide value.

dakiol 3y ago

I don't think that's gonna happen... unless I don't keep learning. Let me explain: I started my career over a decade ago. I knew PHP and MySQL only. Then I moved onto other companies, learnt other stacks (frontend, node, postgres, cloud, go, python, datadog, ci/cd, docker, k8s, aws, etc.). Nowadays it's not hard for me to find a new job. But what would have happened if I stayed with PHP and MySQL and never learnt anything else? I would be jobless. So, I'm not afraid of LLMs replacing me. I think they will open the door to more jobs in IT, actually. I just need to keep learning (and AI has nothing to do with this).

crudcodersare 3y ago
Honestly, thinking you can outpace LLMs with your learning curve is like believing you can outrun a tsunami on a bicycle. Your decade of tech evolution? LLMs do that before breakfast, without the coffee break. The truth is harsh—LLMs are on track to render programmers obsolete, turning your diversified skill set into a quaint relic. Face it, we're not just talking job replacement; we're heralding a new era where coding is an AI's game.
- haliyat 3y ago
  You sound more like an out of touch executive or a recently-converted-Bitcoin-scammer than someone doing real work with this stuff (and yes I saw your top-voted post — as someone who also works in games at a large AAA studio I’ll just say I look forward to the GDC talk showing the evidence).

p1esk 3y ago

You are naive if you think you have 10-15 years. GPT-5 will most likely be out by the end of the year. It will be significantly better than GPT-4. I expect it will replace millions of people - not explicitly - companies will gradually have fewer people doing more work, resulting in increasing layoffs and decreasing hiring. This has already started happening: I spoke to several startup founders recently who use GPT-4 instead of hiring marketing people. GPT-5 will be significantly better at coding, to the point where it might no longer make any sense to hire junior developers. And this is just GPT-5, this year. Next year there will be GPT-6, or an equivalent from Google or Anthropic, and at that point I fully expect a lot of people everywhere getting the boot. Sometime next year I expect these powerful models will start effectively controlling robots, and that will start the process of automation of a lot of physical work. So, to summarize, you have at best 2 years left as a software engineer. After that we can hope there will be some new types of professions that we could pivot to, but I’m struggling to think what could people possibly do better than GPT-6, so I’m not optimistic. I’d love for someone to provide a convincing argument why there would be any delay to the timeline I outlined above. p.s. I just looked at the other 20 responses in this thread, and it seems that every single one is based on current (GPT-4) LLM capabilities. Do people seriously not see any progress happening in the nearest future? Why? I’m utterly baffled by this.

findingMeaning 3y ago
> Why? I’m utterly baffled by this. Yes, me too! I am surprised people are unaware of the empirical power-scale law. [1] Currently, Anthropic's new model has proven it by being better than GPT-4 on some tasks. Yet, the old people are saying it is okay. They are saying engineering is not just coding. What they don't seem to grasp is there won't be a necessity for as many engineers. If people are not willing to accept juniors, where will the next generation of seniors come from? No clue about that. Probably, that spot is reserved for the brilliant minds graduating from R1 institutes. What about the average Joe? Not everyone has the fortune to work on very specialized domain skills. People just don't get it easily. Everyone in academia has admitted to productivity boost by 30-40%. And here we are talking about hard research. Imagine, what it looks for regular job which is managing and maintaining codebases. The severity of this situation is truly alarming not for the greybeards but for us, Zoomers. With climate crisis, AI, geopolitical instability, it feels really great to be alive. [1]: https://arxiv.org/abs/2001.08361 https://arxiv.org/abs/2001.08361

haliyat 3y ago

I’m not at all worried about LLMs replacing even low-level engineers. We’ve been using Copilot and ChatGPT for awhile at work now and the most useful applications we’ve found are more analogous to a compiler than a developer. For example, we’ve had good luck using it to help port a bunch of code between large APIs. the process still involves a lot of human work to fix bugs from its output but a project we estimated at 6 months took three weeks. On the other hand, as someone whose role gives me visibility into the way senior leaders at the company think about what AI will be able to do, I’m absolutely terrified that they’re going to detonate the company by massively over-investing in AI before it’s proven and by forcing everyone to distort their roadmaps around some truly unhinged claims about what AI is going to do in the future. CEOs and senior corporate leaders don’t understand what this technology is and have always dreamed of a world where they didn’t need engineers (or anyone else who actually knows how to make stuff) but instead could turn the whole company into a big “Done” button that just pops out real versions of their buzzword filled fever dreams. This makes them the worst possible rubes for some the AI over-promising — and eager to make up their own! Between this and the really crazy over-valuations we’re already seeing in companies like Nvidia, I’m seeing the risk of a truly catastrophic 2000- or 2008-style economic crash rising rapidly and am starting to prepare myself for that scenario in the next 2-5 years.

crudcodersare 3y ago

Yeah the writing is on the wall. I'm a senior AI programmer for an AAA games studio that you probably know (I worked on a very famous RTS game). I have reduced the code I write by about 90% since ChatGPT 4 was released. My colleagues have also reduced their coding time similiarly. This technology is going to remove all the toil and any need to hire/communicate with junior devs. I imagine it will be the same for other seniors in the programming community. An industry where it's just seniors and LLMs within 4 years is likely, if not sooner, 2 years tbh, and if this slowly transitions to just LLMs and a small team of code reviewers on each site, that would be ideal. Programmers in my area (AI) have a lot of domain knowledge and specialization, we just use code for implementation. So we don't care if LLMs replace coders by auto generating code. All the better for us. The people who are trying to support families ... by offering the world to write CRUD or maintaining codebases are doomed.... they are going to end up as the homeless guy on the street holding a sign saying "will code html for food"

oumua_don17 3y ago
>> Programmers in my area (AI) have a lot of domain knowledge and specialization How long do you think then when LLM's gain this as well? And then?

Ekaros 3y ago

Not too much. Mostly doing security work and lot of can be automated, but still I don't believe LLMs have all the ideas. Same goes for system design and picking the right parts, even if they are ready or can be done by LLM. In the end we need humans as final sanity check or over all design for good while. Or just to decide the right requirements.

aristofun 3y ago

The less experienced you are and less mature as a software engineer — the more fearful. You can literally estimate the proficiency and experience level here in comments. People that have seen some serious sh*t probably won't even bother answering the question.

colund 3y ago

While I agree that LLMs can be useful for coders, and productivity can be increased, coding blindly based on ChatGPT code without understanding concepts could result in very serious bugs. How can you be sure that the code does not have vulnerabilities for example, or solve things in a non-idiomatic way, if you just copy paste code without an understanding. As long as an understanding of the domain and problem is required a skilled person is required between the codebase and the LLM. Even if we get to a point in the future where a programmer can be replaced by an LLM, we'll have businesses where they want someone to use the LLMs to create software.

adawg4 3y ago

Pair programming with AI already is great. I fear if it weeds out experts and people implement AI versions of themselves as offshoot. Seems far away given depth of business logic/available data in those limited spots

deleted 3y ago

[deleted]