10 ms·
A while ago someone posted a claim like that on LinkedIn again. And of course there was the usual herd of LinkedIn sheep who were full of compliments and wows
by misja111 9mo ago
A while ago someone posted a claim like that on LinkedIn again.
And of course there was the usual herd of LinkedIn sheep who were full of compliments and wows about the claim he was making: a 10x speedup of his daily work.
The difference with the zillion others who did the same, is that he attached a link to a live stream where he was going to show his 10x speedup on a real life problem.
Credits to him for doing that! So I decided to go have a look.
What I then saw was him struggling for one hour with some simple extension to his project. He didn't manage to finish in the hour what he was planning to. And when I had some thought about how much time it would have cost me by hand, I found it would have taken me just as long.
So I answered him in his LinkedIn thread and asked where the 10x speed up was. What followed was complete denial. It had just been a hick up. Or he could have done other things in parallel while waiting 30 seconds for the AI to answer. Etc etc.
I admit I was sceptic at the start but I honestly had been hoping that my scepticism would be proven wrong. But not.
- alex1138 9mo agoYou're supposed to believe in his burgeoning synergy so that one day you may collaborate to push industry leading solutions
- ruszki 9mo agoThere were such people also here. Copy-pasting the code would have been faster than their work, and there were several problems with their results. But they were so convinced that their work is quick and flawless, that they post a video recording of it.
- jennyholzer4 9mo agoHackernews is dominated by these people LLM marketers have succeeded at inducing collective delusion
- judahmeek 9mo ago> LLM marketers have succeeded at inducing collective delusion That's the real trick & one I desperately wish I knew how to copy. I know there's a connection to Dunning Kruger & I know that there's a dopamine effect of having a responsive artificial minion & there seems to be some of that "secret knowledge" sauce that makes cults & conspiracies so popular (there's also the promise of less effort for the same or greater productivity). Add the list grows, I see the popularity, but I doubt I could easily apply all these qualities to anything else.
- jennyholzer4 9mo agoIMO algorithmically generated "social" media feeds combined with the lack of adequate mass-media alternatives have supercharged cult recruitment in the last approximately 10 years. Stupid people in my life have been continually and recklessly joining harebrained cults for the last 5 years. Really I think it's probably much, much easier to start a cult these days than it has ever been. Good news for tech company founders I guess, bad news for American culture, American society, and the American people.
- codyb 9mo agoOne way to help stop it is to get off social media and stop giving these tech billionaires so much money. The less people on social media, the less real the network effect is, the less people who join in the first place, the less money the billionaires have to throw hundreds of millions into politics, the less inadvertent cult members. I've gotten to the point where I just leave my phone at home at this point, and it has been incredibly nice. Before that I deleted most apps that I found to be time wastes, deleted all social media (HN and two small discords are my exception). It's very nice, I'm less stressed, I feel more in the moment, I respond to my friends when I check my phone every few hours on the speaker in the other room. I encourage others to try it, add it to your dry January. And ya know what I ain't doing a lick of? Sending money and reams of data to these billionaires I think are really lame individuals with corrupted moral compasses. Now it ain't perfect, I'm sure Google's still getting reams of info about me from my old Gmail account that I still use sometimes, and Apple too from a few sources. But... getting closer! So many folk sit here and recognize the same problems I do, the way it warps your attention, the addictiveness of the handheld devices, the social media echo chambers, the rising influence of misinformation, the lack of clarity between real and fake... Seems like there's a solution in front of us :-)
- lazyfanatic42 9mo agoI think people get into a dopamine hit loop with agents and are so high on dopamine because its giving them output that simulates progress that they don't see reality about where they are at. It is SO DAMN GOOD AT OUTPUT. Agents love to output, it is very easy to think its inventing physics. Obviously my subjective experience
- raducu 9mo ago> I think people get into a dopamine hit loop I also think that's the case, but I'm open to the idea that there are people that are really really good at this and maybe they are indeed 10x. My experience is that for SOME tasks LLMs help a lot, but overall nowhere near 10x. Consistently it's probably.... ~1X. The difference is I procrastinate a lot and LLMs actually help me not procrastinate BECAUSE of that dopamine kick and I'm confident I will figure it out with an LLM. I'm sure there are many people who got to a conclusion on their to-do projects with the help of LLMs and without them, because of procrastination or whatever, they would not have had a chance to. It doesn't mean they're now rich, because most projects won't make you rich or make you any money regardless if you finish them or not
- Majkemilk 9mo ago[dead]
- queueueue 9mo agoIronic that I’m going to give another anecdotal experience here, but I’ve noticed this myself too. I catch myself trying to keep on prompting after an llm has not been able to solve some problem in a specific way. While I can probably do it faster at that point if I switch to doing it fully myself. Maybe because the llm output feels like its ‘almost there’, or some sunken cost fallacy.
- qwery 9mo agoNot saying this is you, but another way to look at it is that engaging in that process is training you (again, not you, the user) -- the way you get results is by asking the chat bot, so that's what you try first. You don't need sunk cost or gambling mechanics, it's just simple conditioning. Press lever --> pellet. Want pellet? --> press lever. Pressed lever but no pellet? --> press lever.
- Folcon 9mo agoI'm going to try and be honest with you because I'm where you were at 3 months ago I honestly don't think there's anything I can say to convince you because from my perspective that's a fools errand and the reason for that has nothing to do with the kind of person either of us are, but what kind of work we're doing and what we're trying to accomplish The value I've personally been getting which I've been valuing is that it improves my productivity in the specific areas where it's average quality of response as one shot output is better than what I would do myself because it is equivalent to me Googling an answer, reading 2 to 20 posts, consolidating that information together and synthesising an output And that's not to say that the output is good, that's to say that the cost of trying things as a result is much cheaper It's still my job to refine, reflect, define and correct the problem, the approach etc I can say this because it's painfully evident to me when I try and do something in areas where it really is weak and I honestly doubt that the foundation model creators presently know how to improve it My personal evidence for this is that after several years of tilting those windmills, I'm successfully creating things that I have on and off spent the last decade trying to create successfully and have had difficulty with not because I couldn't do it, but because the cost of change and iteration was so high that after trying a few things and failing, I invariably move to simplifying the problem because solving it is too expensive, I'm now solving a category of those problems now, this for me is different and I really feel it because that sting of persistent failure and dread of trying is absent now That's my personal perspective on it, sorry it's so anecdotal :)
- brianwawok 9mo agoExample for me: I am primarily a web dev today. I needed some kuberntes stuff setup. Usually that’s 4 hours of google and guess and check. Claude did it better in 15 minutes. Even if all it does is speed up the stuff i suck at, that’s plenty. Oh boy docker builds, saves my bacon there too.
- Draiken 9mo agoAnd you learned nothing and have no clue if what it spit out is good or not. How can you even assume what it did is "better" if you have no knowledge of kubernetes in the first place? It's mere hope. Sure it gets you somewhere but you learned nothing in the way and now depend on the LLM to maintain it forever given you don't want to learn the skill. I use LLMs to help verify my work and it can sometimes spot something I missed (more often it doesn't but it's at least something). I also automate some boring stuff like creating more variations of some tests, but even then I almost always have to read its output line by line to make sure the tests aren't completely bogus. Thinking about it now it's likely better if I just ask for what scenarios could be missing, because when they write it, they screw it up in subtle ways. It does save me some time in certain tasks like writing some Ansible, but I have to know/understand Ansible to be confident in any of it. These "speedups" are mostly short term gains in sacrifice for long term gains. Maybe you don't care about the long term and that's fine. But if you do, you'll regret it sooner or later. My theory is that AI is so popular because mediocrity is good enough to make money. You see the kind of crap that's built these days (even before LLMs) and it's mostly shit anyways, so whether it's shit built by people or machines, who cares, right? Unfortunately I do, and I rather we improve the world we live in instead of making it worse for a quick buck. IDK how or why learning and growing became so unpopular.
- cmiles74 9mo agoI suspect there's also a good amount of astroturfing happening here as well, making it harder to find the real success stories.
- boringg 9mo agoTheres too much money, time and infrastructure committed for this to be anything but successful. Its tougher than a space race or the nuclear bomb race because there are fewer hard tangibles as evidence of success.
- seidleroni 9mo agoI think there is also some FOMO involved. Once people started saying how AI was helping them be more productive, a lot of folks felt that if they didn't do the same, they were lagging behind.
- Bombthecat 9mo agoEven if this would take two, three hours and a vibe coder, still cheaper then a real developer
- dr-detroit 9mo ago[dead]
- GuB-42 9mo ago> What I then saw was him struggling for one hour with some simple extension to his project. He didn't manage to finish in the hour what he was planning to. And when I had some thought about how much time it would have cost me by hand, I found it would have taken me just as long. For all who are doing that, what is the experience of coding in a livestream? It is something I never attempted, the simple idea makes me feel uncomfortable. A good portion of my coding would be rather cringe, like spending way too long on a stupid copy-paste or sign error that my audience would have noticed right away. On the other hand, sometimes, I am really fast because everything is in my head, but then I would probably lose everyone. I am impressed when looking at live coders by how fluid it looks compared to my own work, maybe there is a rubber duck effect at work here. All this to say that I don't know how working solo compares to a livestream. It is more or less efficient, maybe it doesn't matter that much when you get used to it.
- QuercusMax 9mo agoI suspect livestream coding, like programming competition coding and whiteboard coding for interviews, is a separate skill that's fairly well correlated with being able to solve useful problems, but it is not the same thing. You can be an excellent problem solver without being good at doing so while being watched, under time pressure.
- qwery 9mo agoHave done it, never enough of an audience to be totally humiliated. It's never going to be more efficient. But as for your cringe issue that the audience noticed, one could see that to be a benefit -- prefer to have someone say e.g. "you typed `Normalise` (with an 's') again, C++ is written in U.S. English, don't you know / learn to spell, you slime" upfront than waiting for compiler to tell you that `Normalise` doesn't exist, maybe?
- chankstein38 9mo agoSounds like someone trying to sell a course or something.
- jlarocco 9mo agoI've noticed a similar trend. There seems to be a lot of babysitting and hand holding involved with vibe-coding. Maybe it can be a game changer for "non-technical founders" stumbling their way through to a product, but if you're capable of writing the code yourself, vibe coding seems like a lot of wasted energy.
- dpark 9mo ago> So I answered him in his LinkedIn thread and asked where the 10x speed up was. What followed was complete denial. It had just been a hick up. Or he could have done other things in parallel while waiting 30 seconds for the AI to answer. Etc etc. So I’ve been playing with LLMs for coding recently, and my experience is that for some things, they are drastically faster. And for some other things, they will just never solve the problem. Yesterday I had an LLM code up a new feature with comprehensive tests. It wasn’t an extremely complicated feature. It would’ve taken me a day with coding and testing. The LLM did the job in maybe 10 minutes. And then I spent another 45 minutes or so deeply reviewing it, getting it to tweak a few things, update some test comments, etc. So about an hour total. Not quite a 10x speed up, but very significant. But then I had to integrate this change into another repository to ensure it worked for the real world use case and that ended up being a mess, mostly because I am not an expert in the package management and I was trying to subvert it to use an unpublished package. Debugging this took the better part of the day. For this case, the LLM may be saved me maybe 20% because it did have a couple of tricks that I didn’t know about. But it was certainly not a massive speed up. So far, I am skeptical that LLM’s will make someone 10x as efficient overall. But that’s largely because not everything is actually coding. Subverting the package management system to do what I want isn’t really coding. Participating in design meetings and writing specs and sending emails and dealing with red tape and approvals is definitely not coding. But for the actual coding specifically, I wouldn’t be surprised if lots of people are seeing close to 10x for a bunch of their work.
- Kerrick 9mo agoI feel like I've been incredibly productive with AI assisted programming over the past few weeks, but it's hard to know what folks' baselines are. So in the interest of transparency, I pushed it all up to sourcehut and added Co-Authored-By footers to the AI-assisted commits (almost all of them). Everything is out there to inspect, including the facts that I: - was going 12-18 hours per day - stayed up way too late some nights - churned a lot (+91,034 -39,257 lines) - made a lot of code (30,637 code lines, 11,072 comment lines, plus 4,997 lines of markdown) - ended up with (IMO) pretty good quality Ruby (and unknown quality Rust). This is all just from the first commit to v0.8.0. https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0 https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0 What do you think: is this fast, or am I just as silly as the live-streamer? P.S. - I had an edge here because it was a green-field project and it was not for my job, so I had complete latitude to make decisions.
- qwery 9mo agoI don't really know Ruby, so maybe I'm missing something major, but your commit messages seem extremely verbose yet messy (I can't make heads or tails of them) and I'm seeing language like "deprecated" and a stream of "releases" within a period of hours and it just looks a bit like nonsense. Don't take "nonsense" negatively, please -- I mean it looks like you were having fun, which is certainly to be encouraged.
- Kerrick 9mo agoThe commit messages with a Co-Authored-By footer were all generated. I recommend clicking the "tree" link to see the actual code. Specifically: - README.md explains the basics https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/README.md https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/REA... - CHANGELOG.md is better than the commit messages, and filtered to only what app devs using the library likely care about: https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/CHANGELOG.md https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/CHA... - doc/ holds the Markdown documentation, which I heavily reviewed. https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/doc https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/doc - lib/ holds the Ruby source code of the library, which I heavily designed and reviewed. https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/lib https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/lib - examples/ holds the Ruby source code of some toy apps built with the library. https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/examples https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/exa... - bin/ holds a few Ruby scripts & apps to automate some ops (check out announce) https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/bin https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/bin - tasks/ holds some more Ruby scripts & apps to automate some ops (most I did not read, but I heavily designed and reviewed bump and terminal_preview) https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/tasks https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/tas... - ext/ holds the Rust source code of the library, which I did not read most of. https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/ext https://git.sr.ht/~kerrick/ratatui_ruby/tree/v0.8.0/item/ext I was having a lot of fun, and part of the reason I took deprecations and releases seriously was because I hoped to encourage adoption. And that I did: https://todo.sr.ht/~kerrick/ratatui_ruby/4 https://todo.sr.ht/~kerrick/ratatui_ruby/4 and https://github.com/sidekiq/sidekiq/blob/main/bin/tui https://github.com/sidekiq/sidekiq/blob/main/bin/tui
- lossyalgo 9mo agoShopify's CEO just posted the other day that he's super productive using the newest AI models and many of the supportive comments responding to his claim were from CEOs of AI startups.
- cozzyd 9mo ago10 times zero is still zero!
- broochcoach 9mo agoMaybe he would have otherwise struggled for 10 hours on that extension.