5 ms·
I haven't yet seen anyone with a concrete example project (public ideally, but even describing private efforts in enough detail to enable potential criticism wo
by hansvm 5mo ago
I haven't yet seen anyone with a concrete example project (public ideally, but even describing private efforts in enough detail to enable potential criticism would be fine) making a claim as strong as 10x. Are you willing to break the mould and show us what we're all missing?
- ventana 5mo agoIt's more like ∞x (or N/Ax if you prefer) because the majority of the projects I did with LLM agents wouldn't have existed without them, because I would've never found enough time to work on them. One of the latest things I made with Claude was a tool that allowed me to move a bunch of very low traffic Cloud Run services to a single VPS without losing any of the Cloud Run benefits such as easy Docker-based deployment and automatic certificate provisioning. I thought about making something like that for quite some time, and Claude finally made it possible, which makes me quite happy. The fun thing here is that no other soul genuinely cares about it, or any other code I might publish. The code, especially AI generated, is so cheap that if anyone wants to repeat my steps to get rid of Cloud Run services, they will probably vibe-code their own tool instead of figuring out how to use mine, just like I did that instead of spending time on learning Dokku or similar solutions. So, yes, 10x and more, but no one cares about the result, which makes the whole 10x measurement less useful.
- wahnfrieden 5mo agoThe incredulity at 10x claims is often unearned because how much do these skeptics actually notice and appreciate the depth of work of ten developers collaborating on something (if not their own org)? Dev output slips by quietly. There are reams of unnoticed projects even at the scale of a life’s work.
- Capricorn2481 5mo agoThis doesn't pass a sniff test at any small organization. And wouldn't these devs see this 10x claim themselves?
- cyanydeez 5mo agoI'm assuming the devs are seeing 10x code generation and equating that to the improvement. It's when they practically ignore the rabbit holes where it's suspect. I'm definitely seeing speed ups. I troubleshot a linux system yesterday with minimal effort using a local llm. It likely would have taken me a few hours to locate all the docs & testing procedures. the llm did it with only a few prompts. To ensure it did it correctly, I had to interrogate it a few times before letting it proceed. Humans make really bad scientists, and it takes a lot of effort to properly catalog and provide statistics for these things. There is an improvement, but I doubt any random dev can give a real estimate since before LLMs they couldnt really give you a real estimate anyway. I do know when I encounter a bug now, debugging is almost immediately possible.
- steve_adams_86 5mo agoMy small organization is noticing output increasing. We're excited about it. I’m not sure about 10x… Like others have mentioned, it’s difficult because you have to measure different workloads. I build things I never would have. My tooling is better and more robust than ever. I verify and test my work better than ever. I fix more bugs than I used to simply because no one needs to care if it fits into a cycle. I explore and solve more problems in more parts of the application, even if I don’t write code. I take better care of our infrastructure. Performance goes up, bugs go down, AWS resources scale back, costs go down. I’ve paid for my AI usage in scaled back resources several times over at this point. It might not be 10x but it’s a significant multiple.
- TehShrike 5mo agoThere have been plenty of libraries/tools that got people from "I would like to do foo" to "oh, this tool makes foo possible in under 10 hours, I should start working on foo" in the past. LLMs have done this for many foos, which is great. But I'm with hansvm - I haven't actually seen anyone plausibly maintain 10x. 10x is different from getting people past their activation cost.
- viccis 5mo ago>or N/Ax if you prefer It's not a matter of preference
- oaxacaoaxaca 5mo agoI can describe private efforts about a couple recent projects that made me finally believe that Claude Code can actually be a 10x multiplier on certain work. We decided to integrate our SaaS into Microsoft Business Central and NetSuite as plugins into those systems. BC has its own programming language, called AL, that has a lot of idiosyncrasies from any other language I've worked with. And NetSuite plugins are written in SuiteScript, which is a custom JS runtime with a ton of APIs to learn. In the "before", it would've taken 5 developers a year or more to build those integrations. I did both by myself in well under a year. Thank you Claude.
- coldstartops 5mo agoHere is a public project. https://github.com/KeibiSoft/KeibiDrop https://github.com/KeibiSoft/KeibiDrop It took me 2 years ago around 2k hours to build a cross platform FUSE vault, without using AI assisted tools. The pain was debugging through logs and system traces. And understanding how things work. Now managed to ship this one much faster, as an after hours project. Started it in may 2025, and around end of November 2025 started using claude on it. Just by dumping logs into claude, and explaining the attack vector for the problems, saved me the FML moments of grindings walls of syscalls on 3 platforms. I would say much easier to progress, and ship with the same rigour, minimize my time, focus and brain power involvement such that I can put the energy somewhere else.
- corndoge 5mo agoYep, the real strength of AI is less in replacing engineering skills, it's more in slashing all the time we spend not using those skills and doing low level research and data correlation tasks instead. Which isn't to say that those tasks aren't valuable in their own way, but in terms of raw output...
- stephbook 5mo agoI long for the day when they will supervise CI/CD systems. Trying to fix syntax errors in strong interpolation on a 5-minute-delay loop is hell.
- coldstartops 5mo agoIt is possible. I tell to use cli app, and for the agent to ad timer and check the status once in a while. Especially if there is something with a long wait. Also if it can run some validators/ same tools locally, would be much faster. Might tend to deviate and waste time, needs guiding once in a while, and to check what is it spewing out, point it in the correct direction.
- Deeds67 5mo agoJust create a skill for it -> I call mine `babysit`. It spins up a subagent that polls it every x minutes and auto-fixes it until it's green. I already continue with the next task while it does that in the background
- eitland 5mo agoMy friend who has never taken a programming class (or even touched an IDE before AFAIK) has now put a small app into production. Complete frontend + backend + database. Yes, it is an internal app, but it works and everyone loves it. Does that count as an example? (Also I absolutely expect him to need help at some point, but so far it has taken his project from absolutely impossible to 3 weeks of work in between work, renovating his house and being a dad for the first time so I was very impressed.)
- brazukadev 5mo agoMy friend who has never taken a programming class did the same 10 years ago.
- eitland 5mo agoObviously it was not the same s since models that could write programs were not available 10 years ago. And if you just mean your friend taught himself programming on his own, well that is actually very cool, I did too back in the 90ies and so did many others here. My point is that it is now possible to vibe code a full application from frontend to backend today and still not be able to understand a line of TypeScript or anything else.
- brazukadev 5mo ago20 years ago we had cpanel where people without programming knowledge can instantly deploy their own apps. Many people got millionaire doing that, I'd say proportionally probably way more than the people vibecoding solutions. This is not as revolutionary as we thought.
- viccis 5mo agoThese kind of things (internal tools created out of band of normal engineering practices by non-engineers) were amazing back when I did pentesting because the security was always the last consideration. That got harder when SaaS became preferable to rolling your own stuff for everything. Guess things are gonna get fun again for red teams lol
- CraigJPerry 5mo ago10x what? 10x revenue? 10x features shipped? Whats the measure, is it 10x speed of dev like parent comment? Because an unqualified 10x could mean 10x SLOC which is trivial with an agent but has negative value. Assuming 10x on the speed of dev, Is the vscode repo a decent example? Recently they've been all in on AI augmented development so i'm thinking they'd be a reasonable subject? How do you isolate out what counts as the "development" part of their delivery cycle (is that the dev inner loop, does that show up in frequency of commits then?) to measure it and see if it's running 10x? https://github.com/microsoft/vscode/graphs/contributors?from=03%2F05%2F2025 https://github.com/microsoft/vscode/graphs/contributors?from...
- mattbrewsbytes 5mo agoIts 10x code generation with .5x quality at best and all other parts of the SDLC are at 1.x or worse. AI is not delivering 10x shareholder value, anywhere. Software developers have quite the level of hubris about how important they are to companies. Yes our work is very complex and takes a certain mindset to do it well. It takes a lot of other roles to have a successful business, many of those roles will use AI to help draft slide decks, emails, etc. and that's the limit for them. Look at recent companies doing layoffs claiming its because of AI, like CloudFlare and Coinbase, do their reported financials paint the picture that they are crushing it with AI? No, its net losses into the $100's of millions.
- bear8642 5mo ago> AI is not delivering 10x shareholder value, anywhere. A bit facetious, but I'd expect Nvidia and the like providing the "AI equipment" to have a 10× share value at least…
- TheCoelacanth 5mo agoAs always, the real money in a gold rush goes to the people selling shovels.
- timacles 5mo ago
- jgrahamc 5mo agoI am building a better interface for managing KNX systems than the ETS6 software. Code is here: https://github.com/jgrahamc/koolenex https://github.com/jgrahamc/koolenex 1. I would not have attempted this without AI assistance because it's a big project. 2. I have built a functional program that I am able to use for real work in a handful of weeks, working part time on this (like literally a few hours per day prompting Claude and Kimi). 3. Had I decided to do this without AI assistance it would have been months of work.
- ern 5mo agoI suspect that the goalposts for AI-assisted coding will be moved the same way they've been moved for the Turing Test. The Turing Test used to matter until it didn't (does anyone even talk about it? was there a big news conference when it was solved?). Likewise every time it becomes easier to ship software, the bar will be pushed higher by sceptics. Ultimately the gatekeeping is going to become meaningless as software becomes "too cheap to meter".
- Deeds67 5mo agoI'm building an open source Google Photos alternative. Have a look at my project and tell me if you think you could do all this at the same speed without an LLM: https://opennoodle.de https://opennoodle.de Direct github link: https://github.com/open-noodle/gallery https://github.com/open-noodle/gallery
- wallst07 5mo agoIt doesn't completely blow away your argument, but you forked Immich and gave it to a LLM. Which is arguably slightly easier than starting from scratch. Nothing wrong with forks though.
- Deeds67 5mo agoSounds like you're nitpicking on whether or not LLMs make you faster by saying that working on existing code is easier than starting from scratch? I think you've missed the point.
- bronson 5mo agoNo, they're saying that it was misleading. OP said "I'm building an open source Google Photos alternative" and surprisingly didn't say "based on Immich". This dramatically changes the evaluation of "open-noodle". We're now in an era where LoC is easy and design is hard[1]. Starting with an existing project means using an existing design, where someone else has already made many/most of the difficult decisions. 10Xing code without caring about design/UX/DX is trivial. Literally anybody with a token budget can do it. But they probably won't ship a good project. Not with current frontier models. [1]: design has always been hard. But now it's even more difficult because of code veloocity and because LLMs are happier to work with bad code than humans. It's never been easier to go deep into rabbit holes without noticing a single issue.
- Deeds67 5mo agoWhat are you debating here? I replied to a comment asking for examples of public work displaying that LLMs can 10x a human's output. https://opennoodle.de/roadmap/ https://opennoodle.de/roadmap/ Look at what I built, these are not all simple designs.
- wallst07 5mo agoI can state one thing that I'm sure a lot of people connect with, and I don't know if this is 10x, probably not. I've always been a backend engineer, never front end. And almost every team I've been on has lacked any front end skills at all, so all our tools end up being a mash of scripts, maybe sometimes an API. Now we are all front end engineers creating UIs for things we could never do before, and this starts API first development, so the CLI + UI are just calling APIs. Nothing new here, but this used to be what teams do, now a single person does it.
- rjh29 5mo agoIt would not have taken you long to learn frontend if you wanted to. Now you can use AI to generate it but you don't understand any of the generated code.
- eloisant 5mo agoIt's a 10x in areas where I'm not very good/experimented at. Or perhaps even more. For example I'm mostly a backend developer, I used to be a full stack dev a long time ago so I know how to make front-end but my knowledge there is outdated, I've forgotten half of it, it takes me time to get back to it. I'm also not good at creating a web UI so in the past I was using frameworks like Bootstrap or Foundation, leading to sites that looked good but very generic. Now with AI, I can easily create a nice looking front-heavy web app. See this for example: https://github.com/erwan/sovereign-cards-database https://github.com/erwan/sovereign-cards-database I would never have bothered doing that without AI. In areas I'm more familiar with, like back-end software, it's maybe more of the 2x or 3x.
- smartmic 5mo agoIt is worth to have a detailed look into the original essay and its arguments. My interpretation is https://smartmic.bearblog.dev/no-ai-silver-bullet/ https://smartmic.bearblog.dev/no-ai-silver-bullet/
- mohamedkoubaa 5mo agoThere are some things around the corner. The best engineers aren't going 10x on Claude to build the next goofy SaaS app.
- pydry 5mo agoThere is verifiably a flood of new projects. The selfhosted subreddit had to put in checks coz too many people were complaining about vibecoded slop. iOS submissions are way up. What I havent seen is existing open source people develop 10x faster. Or, anything vibe coded get popular which wasnt just a gimmick. Just a tsunami of slop.
- matheusmoreira 5mo agoI have a programming language project: lone lisp. It's on GitHub. I asked Claude to analyze the commit history before and after AI and the result was: with AI I'm committing around 8x faster than before. Lone experienced a literal explosion of features, improvements and fixes after I subscribed to Claude. And this is the project I care most about. I review every single line of code the AI outputs. I push back on everything it does. I reword every commit message. I make every effort to understand how everything works before committing it to master. I cook branches for days and I don't merge until I think it's perfect. Still gave me an ~8x improvement. The latest development: shaped objects, like Self and V8. I asked Claude about it and it just implemented it in like 10 minutes. Boom, instant ~20% speed improvement. I read the code and it turned out to be almost obnoxiously simple. It basically converts hash tables into arrays internally, and deoptimizes back to a hash table if anyone deletes keys from it. I'm still reeling from the sheer absurdity of it.
- vga1 5mo agoIt's often much more than 10x, because AI makes things so much faster and easier that we are now doing many things we wouldn't have bothered to do at all before. And there's no reason to believe we're near the finish line yet as to how good LLMs can get.