9 ms·
95% of Companies See 'Zero Return' on $30B Generative AI Spend
- rogerkirkness 1y agoAI is a deflationary technology, sort of like how most of the cost of TVs is the cost of shipping them from where they are made to where they are used. So wouldn't the returns show up in 'less work needs to be done' slowly over time?
- lazide 1y agoExcept generative AI is mostly an arms race, with content being generated being processed by some other AI on the other side. And any humans unfortunate enough to be in the middle regretting being born.
- seydor 1y agoI'm confused, which point of the hype cycle is this?
- draw_down 1y ago[dead]
- jameskilton 1y agoThe Trough of Disillusion. Though we definitely aren't down there yet, it's coming.
- m_fayer 1y agoYou just wait, when we achieve agi it’ll drive hype cycles at a speed humans have no chance of keeping up with. We will always effectively be in all points of the hype cycle at once. Money will wash randomly through the economy like soap through your laundry. You ain’t seen nothing yet.
- dr_dshiv 1y agoMan, if people aren’t on the plateau of productivity by now with genai, it’s their own damn fault. Trough of disillusionment was like, 2020 AI projects.
- spogbiper 1y agoSounds like 95% of companies are potential clients for my consulting services
- uncircle 1y agoDo you sell overpriced generative AI solutions, or do you consult them on how to pivot away from idiotic generative AI?
- onlyrealcuzzo 1y agoCan't tell if you're in on it, but he's implying this waste is no different than average for consulting
- uncircle 1y agoI take offence at comparing my consulting services writing real software by hand like we did in 2021 with generative AI spambots. (I'm not really offended honestly. Startups will come crying to un-vibe the codebases soon enough.)
- ehutch79 1y agoYES!
- deleted 1y ago[deleted]
- 1y ago
- AstroBen 1y agoThe link to their referenced study doesn't seem to work? This is confusing.. it's directly saying AI is improving employee productivity, but that's not leading to more business profit... how does that happen?
- macintux 1y agoPossible conclusion: most of the work that employees do has no direct impact on earnings.
- AznHisoka 1y agoMaybe they’re measuring productivity by flawed metrics. One could write 10x as much code, but that doesnt mean that will equate to more profit
- addaon 1y ago> AI is improving employee productivity, but that's not leading to more business profit... how does that happen? One trivial way is that the increase of productivity is less than the added cost of the tools. Which suggests that (either due to their own pricing, or just mis-judgement) the AI companies are mis-pricing their tools. If the tool adds $5000 in productivity, it should be priced at $4999, eventually -- the AI companies have every motivation to capture nearly all of the value, but they need to leave something, even if just a penny, for the purchasing company to motivate adoption. If they're pricing at $5001, there's no motivation to use the tool at all; but of course at $4998 they're leaving money on the table. There's no stable equilibrium here where the purchasing companies end up with a /significant/ increase in (productivity - cost of that productivity), of course.
- bilbo0s 1y agothe AI companies are mis-pricing their tools Sounds like the AI companies are not so much mispricing, as the companies using the tools are simply paying wayyy too much for the privilege. As long as the companies keep paying, the AI companies are gonna keep the usage charges as high as possible. (Or at least, at a level as profitable to themselves as possible.) It's unreasonable to expect AI companies to unilaterally lower their prices.
- philipodonnell 1y agoAnyone have a link to the actual report?
- deleted 1y ago[deleted]
- theonionspeaks 1y agohttps://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Bus...
- cstejerean 1y agoWhy do I have a feeling that most of that $30B was spent on paying for consultants, most of which were also essentially making things up as they went along.
- bilbo0s 1y agoI don't know? For some reason, I'm thinking most of the money went to either inferencing costs or NVidia.
- wood_spirit 1y agoAre there really that many consultants floating around still? I remember the heyday of the 2000s and kind of thought the outside consultants were largely disappearing and nowadays companies have trained themselves to jump on the hype train without paying consultants to push them?
- varispeed 1y agoThe funniest part isn’t that AI hasn’t delivered profits. It’s that the only “value” most people got from LLMs was accidentally rediscovering what Google used to be before it turned into an ad-riddled casino. Executives mistook that novelty for a business revolution. After years of degraded search, SEO spam, and “zero-click” answers, suddenly ChatGPT spat out a coherent paragraph and everyone thought: my god, the future is here. No - you just got a glimpse of 2009 Google with autocomplete. So billions were lit on fire chasing “the sliced bread moment” of finally finding information again - except this time it’s wrapped in stochastic parroting, hallucinations, and a SaaS subscription. The real irony is that most of these AI pilots aren’t “failing to deliver ROI” - they’re faithfully mirroring the mediocrity of the organisations deploying them. Brittle workflows meet brittle models, and everyone acts surprised. The pitch was always upside-down. These things don’t think, don’t learn, don’t adapt. They remix. At best they’re productivity duct tape for bored middle managers. At worst they’re a trillion-dollar hallucination engine being sold as “strategy.” The MIT study basically confirms what was obvious: if you expect parrots to run your company, you get birdshite for returns.
- xpe 1y agoGrain of truth acknowledged, though much exaggerated -- to the point of forgetting history. > No - you just got a glimpse of 2009 Google with autocomplete. Go look at the kinds of "answers" you got in 2009 with Google's autocomplete. Time to drop this convenient nicely-packaged narrative. > These things don’t think, don’t learn, don’t adapt. Perhaps some don't -- for some intentionally constructed definitions of these terms. Adding a feedback loop (chain of thought, etc) challenges even such definitions though. > if you expect parrots to run your company, you get birdshite for returns. If this is a reference to "stochastic parrots" metaphor, then I would encourage you to read these articles and HN comments below, which push-back against misunderstandings or overuse of that metaphor: [1]: https://www.lesswrong.com/posts/HxRjHq3QG8vcYy4yy/the-stochastic-parrot-hypothesis-is-debatable-for-the-last https://www.lesswrong.com/posts/HxRjHq3QG8vcYy4yy/the-stocha... [2]: https://www.lesswrong.com/posts/7aHCZbofofA5JeKgb/memetic-judo-3-the-intelligence-of-stochastic-parrots-v-2 https://www.lesswrong.com/posts/7aHCZbofofA5JeKgb/memetic-ju... [3]: https://news.ycombinator.com/item?id=44299996 https://news.ycombinator.com/item?id=44299996 [4]: https://news.ycombinator.com/item?id=44926540 https://news.ycombinator.com/item?id=44926540 [5]: https://news.ycombinator.com/item?id=44967655 https://news.ycombinator.com/item?id=44967655 [6]: https://news.ycombinator.com/item?id=43676755 https://news.ycombinator.com/item?id=43676755 [7]: https://news.ycombinator.com/item?id=43585572 https://news.ycombinator.com/item?id=43585572 [8]: https://news.ycombinator.com/item?id=42351348 https://news.ycombinator.com/item?id=42351348
- aqme28 1y agoThis is why it's so good to sell shovels, so-to-speak. In this case, that's NVDA
- tovej 1y agoThe shovel business is good as long as the gold rush lasts. Once the gold rush is over, you're going to have to deal with a significant decrease in volume, unless you can find other customers. Crypto's over, gaming isn't a large enough market to fill the hole, the only customers that could fill the demand would be military projects. Considering the arms race with China, and the many military applications of AI, that seems the most likely to me. That's not a pleasant thought, of course. The alternative is a massive crash of the stock price, and considering the fact that NVIDIA makes up 8% of everyone's favorite index, that's not a very pleasant alternative either. It seems to me that an ultra-financialized economy has trouble with controlled deceleration, once the hypetrain is on it's full-throttle until you hit a wall.
- taormina 1y agoThere aren’t enough GPUs for average gamers to buy anything vaguely recent and they would love to be able to. Making the best GPUs on the planet is still huge and the market is quite large. Scalping might finally die at this rate, but NVDA wasn’t making any of the scalping money anyway so who cares? Data centers and gamers still need every GPU NVDA can make.
- tovej 1y agoOh there's definitely a market but it's not as big or worth as much the AI market. Gamers don't need GB200s or H100s, and AMD beats Nvidia on price in most segments. Nvidia isn't going to die, but gamers won't fill the demand. Data centers might, but then they'll need something else to compute, and if AI fails to deliver on the big disruptive promises it seems unlikely that other technologies will fill those shoes. I'm just saying that something big will have to change, either Nvidias story or share price. And the story is most likely to pivot to military applications.
- 1y ago
- abrinz 1y agoSkill issue
- mushufasa 1y ago1 in 20 doesn't sound great. But you have to mediate that with - everyone and their mother are doing a "generative ai program" right now, a lot of times just using the label to try to get their project funded, ai being an afterthought - if the 1 out of 20 projects is game-changing, then you could argue right now people should actually be willing to spend even more on the opportunity, maybe the number should actually be 1 in 100. (The VC model is about having big success 1 in 10 times.) - studies of ongoing business activities are inherently methodologically limited by the data available; I don't have a ton of confidence that these researchers' numbers are authoritative -- it's inherently impossible to truly report on internal R&D spend especially a private companies without inside information, and if you have the inside information you likely don't have the full picture.
- JCM9 1y agoWe are entering the “Trough of disillusionment.” These hype cycles are very predictable. GPT-5 being panned as a disappointment after endless hype may go down as GenAI’s “jump the shark” moment. It’s all fun and games until the bean counters start asking for evidence of return on investment. GenAI folks better buckle up. Bumps ahead. The smart folks are already quietly preparing for a shift to ride the next hype wave up while others ride this train to the trough’s bottom. Cue a bunch of increasingly desperate puff PR trying to show this stuff returns value.
- highwaylights 1y agoI wouldn’t be surprised if 95% of companies knew this was a money pit but felt obligated to burn a pile of money on it so as not to hurt the stock price.
- JCM9 1y agoFOMO on the way up to the peak is a powerful force. Now that we’re sliding down the other side FOMO turns into “WTF did we just spend all that money on again?”
- lenerdenator 1y agoI also wouldn't be surprised if bean counters were expecting a return in an unreasonable amount of time. "Hey, guys, listen, I know that this just completely torched decades of best practices in your field, but if you can't show me progress in a fiscal year, I have to turn it down." - some MBA somewhere, probably, trying and failing yet again to rub his two brain cells together for the first time since high school. Just agentic coding is a huge change. Like a years-to-grasp change, and the very nature of the changes that need to be made keep changing.
- dingnuts 1y agoSam Altman and company have been promising full on AGI. THAT'S the price shock. Agents may be good (I haven't seen it yet, maybe it's a skill issue but I'm not spending hundreds of dollars to find out and my company seems reluctant to spend thousands to find out) but they are definitely, definitely not general superintelligence like SamA has been promising at all really is sinking in these might be useful tools, yes, but the market was sold science fiction. We have a useful supercharged autocomplete sold as goddamn positronic brains. The commentariat here perhaps understood that (definitely not everyone) but it's no surprise that there's a correction now that GPT-5 isn't literally smarter than 95% of the population when that's how it was being marketed
- CharlesW 1y agoDuplicate discussion from this week (162 comments): https://news.ycombinator.com/item?id=44941118 https://news.ycombinator.com/item?id=44941118 Here's the source report, not linked to by this content farm's AI-written article: https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Bus...
- pawelduda 1y agoI blame bad prompts /s
- eldenring 1y agoThis is how America ends up being ahead of the rest of world with every new technology breakthrough. They spend a lot of money, lose a lot of money, take risks, and then end up being too far for others to catch up. Trying to claim victory against AI/US Companies this early is a dangerous move.
- ta20240528 1y ago> This is how America ends up being ahead of the rest of world with every new technology breakthrough. Too young to remember GSM?
- eldenring 1y agoI don't think its controversial to say that in net, the US has had a good streak so far with new technologies. Yeah there have been some pretty big misses, but obviously the wins more than make up for them.
- ta20240528 1y agoThe OP said "every" new technology. I just showed this is not true. There are plenty other examples. From the down-votes - either we don't all agree on a common definition of Kings English, or it challenges some members self-identity.
- deleted 1y ago[deleted]
- vdupras 1y ago[flagged]
- onlypassingthru 1y agoWasn't half of Napoleon's army gone by the time he reached Moscow?[0] It's the sunk cost fallacy writ large with dead bodies, no? [0]https://www.researchgate.net/figure/Napoleon-march-graphic-Charles-Joseph-Minards-narrative-map-of-Napoleons-disastrous_fig7_365610171 https://www.researchgate.net/figure/Napoleon-march-graphic-C...
- stephankoelle 1y agoIn some products, certain AI features have become expected. If a product doesn’t include them, it risks losing customers, making it a net negative for the market. At this point, companies either invest in AI or risk falling behind.
- Scarblac 1y agoCan you name some of those products?
- stephankoelle 1y agoA/B Testing: Automate test setup and simplify result analysis. E-commerce: Use AI to generate synonyms for more relevant search results. Issue Tracker: Implement natural language search to find tickets more easily. Sorry, this are only the categories. But i have actual products in mind.
- phplovesong 1y agoNo shit. AI is not "AI", its just a meme word for getting VC cash, because the original term (ML) did not raise any capital. Play stupid games, win stupid prizes.
- IgorPartola 1y agoWhat are the actual use cases that can generate revenue or at least save costs today? I can think of: 1. Generate content to create online influence. This is at this point probably way oversaturated and I think more sophisticated models will not make it better. 2. Replace junior developers with Claude Code or similar. Only sort of works. After all, you can only babysit one of these at a time no matter how senior you are so realistically it will make you, what, 50% more productive? 3. Replace your customer service staff. This may work in the long run but it saves money instead of making money so its impact has a hard ceiling (of spending just the cost of electricity). 4. Assistive tools. Someone to do basic analysis, double check your writing to make it better, generate secondary graphic assets. Can save a bit of money but can’t really make you a ton because you are still the limiting factor. Aside: I have tried it for editing writing and it works pretty well but only if I have it do minimal actual writing. The more words it adds, the worse the essay. Having it point out awkward phrasing and finding missing parts of a theme is genuinely helpful. 5. AI for characters in video games, robot dogs, etc. Could be a brave new frontier for video games that don’t have such a rigid cause/effect quest based system. 6. AI girlfriends and boyfriends and other NSFW content. Probably a good money maker for a decade or so before authentic human connections swing back as a priority over anxiety over speaking to humans. What use cases am I missing?
- b8 1y agoAI Customer Service is very frustrating to work with as a end user.
- siliconc0w 1y agoThe problem is that a lot of friction is intentional. Companies want there to be friction to return an item or cancel a subscription. Insurance companies want there to be friction to evaluate policies or appeal denied claims. Companies create legal friction to make competition harder. The friction is the point so AI isn't a solution. If you were to add AI they'd just find a way to create new friction.
- Spivak 1y agoI mean look, if the customer service department is just trying to frustrate you into not contacting them then AI is just a new tool in the belt for that. Sad, but improvement for them is explicitly worse for you. But if you're actually trying to provide good customer service because people are paying you for it any paying per case then you wouldn't dare put a phone menu or AI chat bot in-between them and the human. The person handles all the interaction with the client and then uses AI where it's useful to speed up the actual work.
- m3kw9 1y agoIs hard to measure return when you prompt a question and it comes out with a partial solution.
- cm2012 1y agoThe report itself can only be viewed by filling out a form - this article is so details light as to be useless.
- lacy_tinpot 1y agoWhy do people so desperately want to see AI fail?
- lkramer 1y agoI think people want to see the mindless application of crappy LLM chatbots and AI summaries everywhere fail. At least that's my position. I would also like the notion that "development can be sped up 6-700% by applying AI" would go away.
- taormina 1y agoWhy do people so desperately want to see AI succeed? The financial investment explains it for some.
- lacy_tinpot 1y agoWhy do want a technology that's able to automate human drudgery? Feels like an absurd question.
- jurking_hoff 1y ago[dead]
- lacy_tinpot 1y agoIt doesn't because we already know it doesn't because just like think about it and it clearly doesn't. So everyone trying to make the technology is a big dumb dumb for even trying. Like is the conclusion we shouldn't even try? This kind of thinking ridiculous.
- yifanl 1y agoSame reason why we aren't looking for innovative ways of using sugary soft drinks as a building material. Just because there's a non-zero chance we could come up with something isn't compelling enough by itself.
- jampa 1y agoThe biggest mistake people are making is treating AI as a product instead of a feature. While people are doing their work, they don't think, "Oh man, I am really excited to talk with AI today, and I can't wait to talk with a chatbot." People want to do their jobs without being too bored and overwhelmed, and that's where AI comes in. But of course, we cannot hype features; we sell products after all, so that's the state we are in. If you go to Notion, Slack, or Airtable, the headline emphasizes AI first instead of "Text Editor, Corporate Chat etc". The problem is that AI is not "the thing", it is the "tool that gets you to the thing".
- jameshart 1y agoAgreed. We’ve got the potential to build real bicycles for the mind here and marketing departments are jumping right in to trying to sell people spandex cycling shorts.
- the_snooze 1y agoI wouldn't mind it if it were presented as yet another tool in the box. Maybe have a one-time popup saying "Hey, there's this thing, here's a cool use case, go check it out on your own terms." In reality, AI sparkles and logos and autocompletes are everywhere. It's distracting. It makes itself the star of the show instead of being a backup dancer to my work. It could very well have some useful applications, but that's for users to decide and adapt to their particular needs. The ham-fisted approach of shoving it into every UI front-and-center signals a gross sense of desperation, neediness, and entitlement. These companies need to learn how to STFU sometimes.
- ryandrake 1y agoI wouldn't even call it a feature. It's enabling technology. I've never once said "I would like AI in [some product]." I say: "I would like to be able to [do this task]." If the company adds that feature to a product, I'll buy it. I don't care if the company used AI, traditional algorithms, or sorcery to make the feature work--I just care that it does what I want it to do. Too many companies are just trying to spoon AI into their product somehow, as if AI itself is a desired feature, and are forgetting to find an actual user problem for it to actually solve.
- TrackerFF 1y agoI'm guessing every VC firm out there is hoping that they'll be the ones that picked the winners - the AI companies that will rule the world in N years.
- os2warpman 1y agoTIL 5% of companies are lying about their financials. (or 5% of companies are selling the pickaxes to the unfortunate miners)
- ApeWithCompiler 1y agoFor the future I will relabel "AI" as "Ain't Interested". But despite the missing return of investment, it only needs a manager or a few, invested enough. They will push layoffs and restructuring regardless of better advice.
- md3911027514 1y agoIt’s interesting how self-reports of productivity can be wrong. For example a study from METR found that developers felt that AI sped them up by 20%, but it empirically it slowed them down by 19%. https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/ https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...
- throitallaway 1y agoSometimes it's like an autocomplete on steroids and reads my mind. Other times it suggests things that make no sense and completely gets in the way.
- sdeframond 1y agoAn interesting study indeed. Not enough data points but still way better than anecdata and self reporting!
- rapind 1y agoI suspect there's a lot of nuance you can't really capture in a study like this. How you use AI will depend on the model, the tools (claude-code vs cursor vs w/e), your familiarity and process (planning phases, vibe coding, etc.), and the team size (solo dev versus large team), your seniority and attention to detail, and hard to measure effects like an increased willingness to tackle harder problems you may have procrastinated on otherwise. I suspect we're heading to a plateau. I think there's a ton of polish that can be done with existing models to improve the coding experience and interface. I think that we're being massively subsidized by investors racing to own this market, but by the time they can't afford to subsidize it anymore, it'll be such a commodity that the prices won't go up and might even go down regardless of their individual losses. As someone who knows they are benefitting from AI (study shmuddy), I'm perfectly fine with things slowing down since it's already quite good and stands to be much better with a focus on polish and incremental improvements. I wouldn't invest in these AI companies though!
- didibus 1y ago> As someone who knows they are benefitting from AI (study shmuddy) XD Look, I get it, I still use it, but you have to admit, people also think that various bogus home remedy totally helps them get over a cold faster. There's absolutely a possibility it in no way makes us faster. Now, you did say "benefit", that's more broad, and you implied things like polish, I've seen others mention it just makes the work easier, that could be a win in itself (for the workers). Maybe it's about accessibility. Etc. I do think though, right now, we're all in the "home remedy" territory, until we actually measure these things.
- xyst 1y agoI am not surprised at all. The capabilities of AI have been vastly oversold. The only winners here are the billionaires that have had early equity/investment in genAI. They got a majority of the country hooked into AI without truly understanding its current limitations. This is just like digital currency bubble/fad that popped a couple of years ago. What most companies got out of it is a glorified chatbot (ie, something that was possible in 2014…) at 1000X the cost. What a sad joke. Innovation in this country is based on a lie, fueled by FOMO.
- jawns 1y agoFull disclosure: I'm currently in a leadership role on an AI engineering team, so it's in my best interest for AI to be perceived as driving value. Here's a relatively straightforward application of AI that is set to save my company millions of dollars annually. We operate large call centers, and agents were previously spending 3-5 minutes after each call writing manual summaries of the calls. We recently switched to using AI to transcribe and write these summaries. Not only are the summaries better than those produced by our human agents, they also free up the human agents to do higher-value work. It's not sexy. It's not going to replace anyone's job. But it's a huge, measurable efficiency gain.
- ddddang 1y ago[dead]
- zeromyte 1y ago[dead]
- vasco 1y agoI wonder if the human agents agree the AI summaries are better than their summaries. I was nodding as I read and then told myself "yeah but it wouldn't be able to summarize the meetings I have", so I wonder if this only works in 3rd person.
- deleted 1y ago[deleted]
- dymk 1y agoHave you tried having it summarize the meetings you have?
- mbStavola 1y agoPart of me also wonders if people may agree that its better simply because they don't actually have to do the summarization anymore. Even if it is worse by some %, that is an annoying task you are no longer responsible for; if anything goes wrong down the line, "ah the AI must've screwed up" is your way out.
- dsr_ 1y ago"I'm sure my company is among the 5% of superusers," said CEO Chad "Bro" Brochad, who later admitted he had not checked.
- jurking_hoff 1y ago[dead]
- Terr_ 1y agoCan you really put a price on a good excuse for layoffs that deflects rancor from employees while sounding like positive news to investors? :p ... Well, probably yes, but I don't have the data to do it.
- tqi 1y agoThe link to the report pdf redirects to a landing page[1] that makes me think this "study" is run-of-the-mill content marketing. The CTA at the bottom of the page says "Join the Revolution / Be at the forefront of creating the agentic web. Get exposure and faster adoption for your AI products and tools," which certainly doesn't give the impression that this is an objective report. Either way I can't speak to the quality of the study directly because it is walled off behind a contact information form, which is another bad sign. From the article though: > But researchers found most use cases were limited to boosting individual productivity rather than improving a company’s overall profits. What does that even mean? [1] Website: https://nanda.media.mit.edu/ https://nanda.media.mit.edu/, FAQ: https://projnanda.github.io/projnanda/#/faq_nanda https://projnanda.github.io/projnanda/#/faq_nanda
- leetharris 1y agoTry to click the author name. It doesn't work. This isn't a real author or a real site. HN is turning into reddit, where people look at the title, come to the comments, and post if they agree with the title or not.
- kingstnap 1y agoI mean of course they aren't. So many people are offering so much stuff for free or at a pittance. I honestly don't think it matters though. Feel free to disagree with me but I think the money is irrelevant. The only thing that actually matters is the long run is the attention, time, and brain space of other people. After all that's where fiat currency actually derives it's value. These Gen AI companies have captured a lot of that extremely quickly. OpenAI might have "burned" billions but they way they have wrung themselves into seemingly every university student's computer, every CEOs mind, the policy decisions of world leaders, ever other hackernews post, is nothing short of miraculous...
- justinator 1y agoIt HAS lead to widespread enshitification of products and services though!
- mannyv 1y agoMy daughter, as an intern, created a whole set of prompts for a metal fab that extracted all the metal parts out of a CAD file (or PDF) and dimensions so it's easier for them to bid. Saved them hours of work. Of course, they didn't spend on "AI" per se. Most people don't know how to meta their job functions, so AI won't really be worth it. And the productivity gains may not be measurable ie: "I did this in 5 minutes instead of 500, so I was able to goof off more."
- phlipski 1y agoThis sounds fascinating! I'd like to learn more about using AI for CAD file generation - since freecad is miserable to use! Can you share more on this?
- ryeguy_24 1y agoDoes anyone have this mystical report?
- nerevarthelame 1y agohttps://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Bus...
- rconti 1y agoI'm no AI apologist, but for one, this is how investments, particularly speculative investments, work. They're investing money now in the _hopes_ of a future return. It's pretty early days still. Secondly, of _course_ the huge AI players are doing everything they can to overpromise and convince corporations to throw cash at them to keep the party going. I think the real problem is, it's just a bit too early, but every CEO out there dreams of being lauded for their visionary take on AI, and nobody wants to miss the bus. It's high-leverage tech, so if it (some day) does what it's supposed to do, and you miss making the investment at the right time, you're done.
- maerF0x0 1y agoIf everyone does it, then no one gets an advantage, because all see a productivity boost. If you do not do it, you get left behind and cannot compete in the marketplace. I took a business systems administration course like 20 years ago, and they knew this was the case. As far as we can tell it's always been the case. IT doesn't create massive moats/margins because price competition erodes the gap. And yet if you do not keep up you lose. It's definitely a boon for humanity though, in the industries where technology applies things have been very obviously getting much cheaper over time. (Most notably American housing has been very very resistant to technological change and productivity gains, a part of the story why housing has gone way up) - https://youtu.be/VfYp9qkUnt4?si=D-Jpmojtn7zV5E8T https://youtu.be/VfYp9qkUnt4?si=D-Jpmojtn7zV5E8T
- manishsharan 1y agoI am not interested in the results of the 95%. I want to know more about the 5% who got it right. What are their use cases ?
- deleted 1y ago[deleted]
- revskill 1y agoBecause they are doom to fail.
- morelandjs 1y agoI’d have to guess that new startup founders are building leaner teams leading to slower burn rates and longer run ways. That has value. I think share skepticism is warranted is whether or not old behemoths can retrofit AI efficiency gains into their existing organizational structures.
- crowcroft 1y agoIMO 'Zero return' is really just saying that these companies never had a plan for their AI implementation in the first place, and so never had any idea what they were trying to achieve and measure in the first place. The article does call out clear issues companies have with AI workflows etc. and those are likely real problems, but if you're saying *zero* return those aren't the root cause problems.
- seatac76 1y agoEd Zitron was right all along eh.
- ChrisArchitect 1y agoEarlier discussion on the report: AI is predominantly replacing outsourced, offshore workers https://news.ycombinator.com/item?id=44940944 https://news.ycombinator.com/item?id=44940944 PDF report that was taken down/walled: https://web.archive.org/web/20250818145714/https://nanda.media.mit.edu/ai_report_2025.pdf https://web.archive.org/web/20250818145714/https://nanda.med...
- pjmlp 1y agoI can hardly wait for the bubble to burst, now everyone is forced to meet OKRs on using AI at work, while at the same time, being forbidden to use the data that actually makes the tools usable.
- turnsout 1y agoThe AI wave is so reminiscent of the early days of the internet. Right now we're in about 1999, a time of tremendous hype. Business that weren't even in tech were wondering how much they need to know about the HTTP spec. People from the marketing team were being pulled off their print ad campaigns, given a copy of Dreamweaver, and told to make the company website. We hadn't even figured out the roles. It 100% turned out to be a bubble and yet, if anything, the internet was under-hyped. The problem in 1999 was that no one really knew how it was going to play out. Which investments would be shrewd in retrospect, and which ones would be a money pit? When an innovation hits, it takes time to figure out whether you're selling buggy whips, or employing drivers who can drive any vehicle. Plenty of companies sunk way too much money into custom websites back in 99, but would we say they were wrong to do it? They may have overspent at a time when a website couldn't justify the ROI within 12 months, but how could they know? A few short years later, a website was virtually required for every business. So are companies really seeing "zero return" on their AI spend, or are they paying for valuable lessons about how AI applies to their businesses? There may be zero ROI today, but all you need to do is look at the behavior of normal people to see that AI is not going anywhere. Smart companies are experimenting.
- llmllmkom 1y agoThe internet is about sharing actual information. LLMs can't share real information, just a flimsy derivative. It's in their DNA. How so many supposedly smart people who understand machine learning and its fundamental entropy failed to acknowledge this reality from day zero, is beyond me.
- turnsout 1y agoNot every revolution is about sharing information. I have plenty of healthy skepticism of companies adding "AI sauce" to everything, but if you can't see the genuine utility of LLMs, it might just be a failure of imagination.
- foxfired 1y agoAtlassian added this new AI feature to create audio summaries of Confluence documents. It's really impressive. No one reads documentation. I know it because I'll send someone a documentation, then they'll ask me a question that is answered in the second paragraph, meaning they didn't read it. So their feature is not just text to speech, but a reading of a summarized version of the articles. But here is the problem. The documentation has no fluff. You don't want a summary, you want the actual details. When you are reading the document that describes how the recovery fee is calculated, you want to know exactly how it is calculated. I've ran it on multiple documents and it misses key information. An unsuspecting user might take it at face value. So this feature looks impressive, but it misses the entire point of documentation. Which is *preserving the details*.
- swader999 1y agoAI reads the docs. For the first time in twenty years I'm actually advocating for more documentation.
- GloriousMEEPT 1y agoOne thing I ponder after remembering previous tech booms, is that they often left behind something extremely valuable (fiber). With all the GPU datacenters rolling out, what next bubble can take advantage of this boon, if it is one?
- wheelerwj 1y agoMy guess is that this title could also be written as, “The value of AI projects are being captured by just 5% of companies.” It’s pretty clear to anyone who’s using this technology that it’s significant. Theres still tons to work out and the exact impact is still unknown. But this cat isn’t going back in the bag.
- LPisGood 1y ago> It’s pretty clear to anyone who’s using this technology that it’s significant I disagree entirely. It’s neat, and it’s a marginal improvement over current-year google, but significant is an overstatement.
- resiros 1y agoHere is the report: https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Bus... The story there is very different than what's in the article. Some infos: - 50% of the budgets (the one that fails) went to marketing and sales - the authors still see that AI would offer automation equaling $2.3 trillion in labor value affecting 39 million positions - top barriers for failure is Unwillingness to adopt new tools, Lack of executive sponsorship Lots of people here are jumping to conclusions. AI does not work. I don't think that's what the report says.
- baal80spam 1y ago> Lots of people here are jumping to conclusions. AI does not work. I don't think that's what the report says. Well... "It is difficult to get a man to understand something when his salary depends upon his not understanding it"
- didibus 1y ago> affecting 39 million positions Wow, that is crazy. There's 163 million working Americans, that's close to a quarter of the workforce is at risk.
- rawgabbit 1y agoThis stood out to me in the report: A corporate lawyer at a mid-sized firm exemplified this dynamic. Her organization invested $50,000 in a specialized contract analysis tool, yet she consistently defaulted to ChatGPT for drafting work: "Our purchased AI tool provided rigid summaries with limited customization options. With ChatGPT, I can guide the conversation and iterate until I get exactly what I need. The fundamental quality difference is noticeable, ChatGPT consistently produces better outputs, even though our vendor claims to use the same underlying technology." This pattern suggests that a $20-per-month general-purpose tool often outperforms bespoke enterprise systems costing orders of magnitude more, at least in terms of immediate usability and user satisfaction. This paradox exemplifies why most organizations remain on the wrong side of the GenAI Divide.
- 1y ago
- bishnu 1y agoThe illustrative example to me is the construction of railroads at the beginning of the Industrial revolution. Unquestionably useful, unquestionably important there were nevertheless at least 3 speculative financial bubbles centered on railway construction.
- paul7986 1y agoPresent day AI (chatGPT 5) is not a complete graphic/web designer or front-end developer. My job and skills are safe from it as it can't... - Make edits to the solid looking logos & web designs it spits out. Instead it creates brand new logos and designs ..not what i asked it to do! - Front end code it doesn't spit a zip file with all the images. It does speed up my design/development (I use code to design) process where I use to design/develop in the browser using a bootstrap template. Maybe it will finally figure it out and or maybe its just the Wizard of Oz .. a facade that grabs designs off the web and mixes some up but can never make edits.
- deleted 1y ago[deleted]
- deleted 1y ago[deleted]
- mwkaufma 1y agoLevels of cope in this thread many previously thought impossible.
- ozgung 1y agoSo, on August 21, 2025, everyone in the world suddenly decided that AI was a bubble, no matter what day had said the day before. And they decided to start a PR campaign to announce this to the general public. CEOs were overselling, now they are underselling (their job is to sell). What's going on? I find all of these pretty sus.
- chriskanan 1y agoWhere is the actual paper that makes these claims? I'm seeing this story repeated all over today, but the link doesn't actually seem to go to the study. I am not going to trust it without actually going over the paper. Even then, if it isn't peer-reviewed and properly vetted, I still wouldn't necessarily trust it. The MIT study on AI's impact on scientific discovery that made a big splash a year ago was fraudulent even though it was peer reviewed (so I'd really like to know about the veracity of the data): https://www.ndtv.com/science/mit-retracts-popular-study-claiming-ai-boosts-scientific-discoveries-8446444 https://www.ndtv.com/science/mit-retracts-popular-study-clai...
- Workaccount2 1y agoAn alternative headline is "90% of employees report using LLMs regularly" The story is a "Pick your narrative" one. https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Bus...
- yalogin 1y agoThis is looking more like an enterprise cycle instead of a consumer one. I may be a bit jaded or over simplifying things, but I see this AI cycle as redoing enterprise workflows using AI. Not all of them will benefit from it and even then the incremental benefit or ROI from switching to an genAI automation is being questioned here.
- Aperocky 1y agoIf there are zero return, then something is not being done right. AI had led to significant operational improvements. The speed of root causing has increased by multiple times and the time spent head-desking or chasing leads have reduced significantly - even if the AI is wrong the first few times, it is recognizable that it would sometime be a rabbithole that I myself were likely to spend time - a lot longer time in. It obviously cannot do these things by itself because it can arrive at the wrong conclusion all the time and be pretty stubborn about it, but at the same time to say there are no benefit is like throwing a bike away because you fell riding it the first time and go back to walking.
- czhu12 1y agoAs much as I also want to jump on the ai bubble bandwagon (who doesn’t love a good bit of pessimism), I’m still mind blown daily by how these models operate. I recently ported over a fastapi app to Django with Claude code and it was at least twice as fast as I probably would’ve been able to do myself, and I only had to somewhat pay attention. What would’ve been a pretty intense few days turned into about 2 hours of mindless work while tens of thousands of lines were ported over, tested, and refactored
- Workaccount2 1y agoHow unfortunate would it be if people actually read the report https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Bus... > While only 40% of companies say they purchased an official LLM subscription, workers from over 90% of the companies we surveyed reported regular use of personal AI tools for work tasks. In fact, almost every single person used an LLM in some form for their work. In many cases, shadow AI users reported using LLMs multiples times a day every day of their weekly workload through personal tools, while their companies' official AI initiatives remained stalled in pilot phase. Corporate initiatives are failing, but people are using LLMs like crazy at work. This story is not the bombshell it's made out to be, in fact it could even go in the other direction.
- 1vuio0pswjnm7 1y agoSolution looking for problem
- kin 1y agoI'm sick and tired of seeing similar headlines and articles that reference the MIT report. It is incredible lazy journalism and borderline click bait. The MIT report was created by project NANDA, a very pro-AI group. Read about them here: https://nanda.media.mit.edu/ https://nanda.media.mit.edu/ The original Fortune article here: https://fortune.com/2025/08/18/mit-report-95-percent-generative-ai-pilots-at-companies-failing-cfo/ https://fortune.com/2025/08/18/mit-report-95-percent-generat... cites specifically generative AI pilot programs. From the article: "But for 95% of companies in the dataset, generative AI implementation is falling short. The core issue? Not the quality of the AI models, but the “learning gap” for both tools and organizations. While executives often blame regulation or model performance, MIT’s research points to flawed enterprise integration." You could have a pile of cash and 95% of companies will fail to see zero return because they don't know how to pick up the money.
- Havoc 1y agoWhat I found most interesting about the stat is how media spun it. At a glance they're similar...but the closer you look the more you notice writers are playing it fast & loose: >only 5 percent of custom enterprise AI tools reach production >95% of Enterprise AI Pilots Fail to Boost Revenues >Why are 95% of GenAI pilot projects failing? >95% of Companies See 'Zero Return' >5% of integrated AI pilots are extracting millions in value >95% of generative AI implementations in enterprise 'have no measurable impact on P&L'
- IT4MD 1y agoHappy to hear this.