3 ms·

These are the perfect size projects vibe coding is currently good for. So far... it's going to keep getting better to the point until all software is written t

These are the perfect size projects vibe coding is currently good for. So far... it's going to keep getting better to the point until all software is written this way.

spzb 10mo ago
I've got a bridge to sell you
__MatrixMan__ 10mo ago
It seems like it's approaching a horizontal asymptote to me, or is at the very least concave down. You might be describing a state 50 years from now.
- anthonypasq 10mo ago
  sonnet 3.7 was released 10 months ago! (the first model truly capable of any sort of reasonable agentic coding at all) and opus 4.5 exists today.
  - rabf 10mo ago
    To add to this: the tooling or `harness` around the models has vastly improved as well. You can get far better results with older or smaller models today than you could 10 months ago.
    - theshrike79 10mo ago
      The harnesses are where most progress is made at the moment. There are some definite differences in the major models as to what kind of code they prefer, but I feel the harnesses make the biggest difference. Copilot + Sonnet is a complete idiot at times, while Claude Code + Sonnet is pretty good.
- aurareturn 10mo ago
  It seems like progress is accelerating, not slowing down. ARC AGI 2: https://x.com/poetiq_ai/status/2003546910427361402 https://x.com/poetiq_ai/status/2003546910427361402 METR: https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/ https://metr.org/blog/2025-03-19-measuring-ai-ability-to-com...
  - __MatrixMan__ 10mo ago
    Improved benchmarks are undeniably an improvement, but the bottleneck isn't the models anymore, it's the context engineering necessary to harness them. The more time and effort we put into our benchmarking systems the better we're able to differentiate between models, but then when you take an allegedly smart one and try to do something real with it, it behaves like a dumb one again because you haven't put as much work into the harness for the actual task you've asked it to do as you did into the benchmark suite. The knowledge necessary to do real work with these things is still mostly locked up in the humans that have traditionally done that work.
    - aurareturn 10mo ago
      The systems around the LLM will get built out. But do you think it will take 50 years to build out like you said before? I’m thinking 5 years at most. The key is that the LLMs get smart enough.
      - __MatrixMan__ 10mo ago
        The more I think of it the less likely I think it is that "all code written via LLM" will happen at all. I use LLMs to generate systems that interpret code that I use to express my wishes, but I don't think is would be desirable to express those wishes in natural language all of the time.
        aurareturn 10mo ago
        That's why people don't think software engineers as a profession will disappear. It'll just change.
rvz 10mo ago
Air traffic control software is not going to be vibe-coded anytime soon and neither is the firmware controlling the plane.
- A4ET8a8uTh0_v2 10mo ago
  I will be perfectly honest. Given what I am seeing, I fully expect someone to actually try just that.
- aurareturn 10mo ago
  Sure it will. But they will be tested far more stringently by both human experts and the smartest LLM models.
- blks 10mo ago
  Considering how much work at Boeing is given to consultants and other third party contractors (eg famous MCAS), some piece of work after moving through the bowls of multiple subcontractors will end up in the hands of a under-qualified developer who will ask his favourite slop machine to generate code he doesn’t exactly understands purpose of.
croes 10mo ago
Successfully building an IKEA shelf doesn’t make you a carpenter.
- exe34 10mo ago
  no, but I have furniture. it's important to keep sight of the end goal, unless the carpentry is purely a hobby.
  - whattheheckheck 10mo ago
    What's the job title and education requirements for designing the supply chain and engineering of the ikea furniture?
    - exe34 10mo ago
      I don't know, I don't work at IKEA. Sorry.
HarHarVeryFunny 10mo ago
Sure, but that's basically the same as saying that we'll have human-equivalent AI one day (let's not call it AGI, since that means something different to everyone that uses it), and then everything that humans can do could then be done by AI (whether or not it will be, is another question). So, yes, ONE DAY, AI will be doing all sorts of things (from POTUS and CEO on down), once it is capable of on-the-job learning and picking up new skills, and everything else that isn't just language model + agent + RAG. It the meantime, the core competence of an LLM is blinkers-on (context-on) executing - coding - according to tasks (part of some plan) assigned to it by a human who, just like a lead assigning tasks to human team members, is aware of what it can and can not do, and is capable of overseeing the project.

These are the perfect size projects vibe coding is currently good for. So far... it's going to keep getting better to the point until all software is written this way.

spzb 10mo ago

I've got a bridge to sell you

__MatrixMan__ 10mo ago

It seems like it's approaching a horizontal asymptote to me, or is at the very least concave down. You might be describing a state 50 years from now.

anthonypasq 10mo ago
sonnet 3.7 was released 10 months ago! (the first model truly capable of any sort of reasonable agentic coding at all) and opus 4.5 exists today.
- rabf 10mo ago
  To add to this: the tooling or `harness` around the models has vastly improved as well. You can get far better results with older or smaller models today than you could 10 months ago.
  - theshrike79 10mo ago
    The harnesses are where most progress is made at the moment. There are some definite differences in the major models as to what kind of code they prefer, but I feel the harnesses make the biggest difference. Copilot + Sonnet is a complete idiot at times, while Claude Code + Sonnet is pretty good.
aurareturn 10mo ago
It seems like progress is accelerating, not slowing down. ARC AGI 2: https://x.com/poetiq_ai/status/2003546910427361402 https://x.com/poetiq_ai/status/2003546910427361402 METR: https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/ https://metr.org/blog/2025-03-19-measuring-ai-ability-to-com...
- __MatrixMan__ 10mo ago
  Improved benchmarks are undeniably an improvement, but the bottleneck isn't the models anymore, it's the context engineering necessary to harness them. The more time and effort we put into our benchmarking systems the better we're able to differentiate between models, but then when you take an allegedly smart one and try to do something real with it, it behaves like a dumb one again because you haven't put as much work into the harness for the actual task you've asked it to do as you did into the benchmark suite. The knowledge necessary to do real work with these things is still mostly locked up in the humans that have traditionally done that work.
  - aurareturn 10mo ago
    The systems around the LLM will get built out. But do you think it will take 50 years to build out like you said before? I’m thinking 5 years at most. The key is that the LLMs get smart enough.
    - __MatrixMan__ 10mo ago
      The more I think of it the less likely I think it is that "all code written via LLM" will happen at all. I use LLMs to generate systems that interpret code that I use to express my wishes, but I don't think is would be desirable to express those wishes in natural language all of the time.
      - aurareturn 10mo ago
        That's why people don't think software engineers as a profession will disappear. It'll just change.

rvz 10mo ago

Air traffic control software is not going to be vibe-coded anytime soon and neither is the firmware controlling the plane.

A4ET8a8uTh0_v2 10mo ago
I will be perfectly honest. Given what I am seeing, I fully expect someone to actually try just that.
aurareturn 10mo ago
Sure it will. But they will be tested far more stringently by both human experts and the smartest LLM models.
blks 10mo ago
Considering how much work at Boeing is given to consultants and other third party contractors (eg famous MCAS), some piece of work after moving through the bowls of multiple subcontractors will end up in the hands of a under-qualified developer who will ask his favourite slop machine to generate code he doesn’t exactly understands purpose of.

croes 10mo ago

Successfully building an IKEA shelf doesn’t make you a carpenter.

exe34 10mo ago
no, but I have furniture. it's important to keep sight of the end goal, unless the carpentry is purely a hobby.
- whattheheckheck 10mo ago
  What's the job title and education requirements for designing the supply chain and engineering of the ikea furniture?
  - exe34 10mo ago
    I don't know, I don't work at IKEA. Sorry.

HarHarVeryFunny 10mo ago

Sure, but that's basically the same as saying that we'll have human-equivalent AI one day (let's not call it AGI, since that means something different to everyone that uses it), and then everything that humans can do could then be done by AI (whether or not it will be, is another question). So, yes, ONE DAY, AI will be doing all sorts of things (from POTUS and CEO on down), once it is capable of on-the-job learning and picking up new skills, and everything else that isn't just language model + agent + RAG. It the meantime, the core competence of an LLM is blinkers-on (context-on) executing - coding - according to tasks (part of some plan) assigned to it by a human who, just like a lead assigning tasks to human team members, is aware of what it can and can not do, and is capable of overseeing the project.