5 ms·
95% of AI Pilots Fail
- flembat 1y agoThis is why I will never get in an AI plane.
- anonymars 1y agoA one-word difference in the title (Pilot Projects) would have saved a lot of confusion Just like what often happens in software documentation: a few seconds in the right spot can save hours or weeks of Chesterton Fence work
- Edd314159 1y agostop putting them in control of aircraft then
- zahlman 1y agoI made this joke (https://news.ycombinator.com/item?id=44941459 https://news.ycombinator.com/item?id=44941459) last time (https://news.ycombinator.com/item?id=44941118 https://news.ycombinator.com/item?id=44941118).
- a4isms 1y agoHow about if it's just to land the aircraft? https://www.garmin.com/en-US/autonomi/autoland/ https://www.garmin.com/en-US/autonomi/autoland/
- 15155 1y agoIsn't this accomplished via an almanac of published ILS Category III airports and their runways? I thought this system just picked the closest runway and broadcasts "get out of my way, I'm making an emergency landing!"
- DeepYogurt 1y agoWhat I wouldn't give to live in a world where people had long term goals.
- deleted 1y ago[deleted]
- LtWorf 1y agoFor that you need the emperor to fuse himself with sandworms so that he can live thousands of years.
- spogbiper 1y agothis is an advertisement for a company promising to make your pilot one of the 5% that succeed
- creesch 1y agoI mean sure, but it is based on an actual MIT study. Which they are clearly trying to spin in their favor, but real data nonetheless.
- diggan 1y ago> based on an actual MIT study Speaking of which, anyone have a link to the study itself? Since the linked marketing post doesn't even provide a link to it, just a bunch of links to their own platform and social media accounts. Probably better for the submission to link directly to the study, without the extra call-to-action fluff at the end?
- creesch 1y agoIt was mentioned and discussed in a fair amount of other articles and blog posts on HN as well. So it was fairly easy to find: https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Bus...
- spogbiper 1y agoi found this analysis interesting - https://www.youtube.com/watch?v=5QzqyrnL010 https://www.youtube.com/watch?v=5QzqyrnL010
- spogbiper 1y agospecifically, a study done by the NANDA group at MIT https://nanda.media.mit.edu/ https://nanda.media.mit.edu/ they seem to be pushing their own take on how to implement agentic AI frankly this study and the headlines surrounding it all seem like a bunch of marketing spin
- vcryan 1y agoThe main reason pilots fail is that people don't see the value. If they did, they might have addressed many of the issues described in the report as the cause of the failures.
- mrweasel 1y agoMany of the same issues would equally trip up none AI project. One reason these project might fail is because, like so many other things in business, AI is thrown at a project to cover up organisations short coming, terrible procedures, poor data management and many other issues. I'm not the biggest fan of current AI technology, but claiming that it's a failure because it doesn't magically solves your problems, which was always more organisations/managerial in nature rather than technical, is a little disingenuous.
- citizenpaul 1y agoStep one. Don't absentmindedly twirl your mustache while mumbling how you can finally get rid of all these troublesome employees.
- realz 1y agoBut I had a two hour conversation with ChatGPT and we couldn’t come up any scenario where I didn’t end up winning.
- elif 1y agoThat may be true but what happens when 5% grow exponentially.
- markasoftware 1y agoif 5% grows exponentially, it'll become 0.025%, then 0.00125%, ...
- srameshc 1y agoI found this company today https://www.usemotion.com/ai-employees/ai-sdr https://www.usemotion.com/ai-employees/ai-sdr and they are selling AI employees. I understand the need to sell. But if you are selling tools as employees, then there is something that will break eventually. I agree with most of the sentiment, that don't try to invest thinking people will be replaced. Make your employees efficinet with tools.
- kelseyfrog 1y agoThere's a huge opportunity to pair this with gig workers to embody AI intelligence with human presence. Kind of like the LinkedIn version of Surroo[1]. 1. https://surroo.me/ https://surroo.me/
- malthaus 1y ago95% of any pilots at corporates fail, probably even more than that, you don't need ai for that
- username_my1 1y agoI still remember the 2015 alexa 100M$ fund and the buzz around everything voice first. https://www.geekwire.com/2015/amazon-makes-echos-alexa-available-to-developers-and-device-manufacturers-launches-100m-fund/ https://www.geekwire.com/2015/amazon-makes-echos-alexa-avail... of course it wasn't as big as this new AI push, but since the 80s AI over promised and under devlivered, it's not the fault of AI, but the greed of the business people.
- guluarte 1y agoremember Cortana?
- Aurornis 1y agoThis article's structure and wording feel like it was barely tweaked after coming out of ChatGPT. Anyway, it misses one of the current biggest problems with all things AI in the workplace: It has attracted every resume-builder and ladder-climber who don't know what they're doing. They just want an AI initiative for their resume. As long as it's not too public (like the Taco Bell AI drive through disaster) it doesn't really matter if it's successful or not. They can spin it as a success and the next company they apply to won't be able to check. The same thing happened a few years ago when every PM and rising manager was looking for a way to put blockchain into products. Before that it was "big data", and so on.
- th0ma5 1y agoIt's wild to see would-be influencers continue to build upon a pile of sand, each trying to out pace the lingo on one hand and clinging to anecdotes and conjecture on the other. I wish like other technologies there were first principals that everyone could agree on but you still see it here with people offering what worked for them as some kind of objective fact. Someone should study how these influencer tactics are short circuited by this stuff?
- Hendrikto 1y ago100% agree. > Before that it was "big data", and so on. Cloud, micro services, NoSQL, serverless, … We never learn :(
- ambicapter 1y ago> This article's structure and wording feel like it was barely tweaked after coming out of ChatGPT. eugh, yeah that's definitely the case. I stopped reading once I got to the first repeated paragraph about data quality.
- burnte 1y agoIMO the step most of these projects fail on is UTILITY. I have yet to hear an AI project start with, "We need to do X and I think AI might help." Every single project meeting I've sat in started with an non-technical exec asking, "what can we use AI for?" They've got a solution and go looking for a problem so they can say they're using AI. At my last company thankfully I was able to limit the losses to just under $450k which sounds like a lot, and it is, but it could have been about $5m/yr. I didn't sabotage anything, either. It was mostly through simply asking a lot of questions early, repeatedly suggesting we write plans down and make sure everyone on the project is up to day, and suggesting we test drive components before buying the whole car. Spent a bunch of money, rolled out the pilot project to 70 folks, and began 30 day checkins. After 30 days we had a retention rate over 80%. By the 60 day mark, we were down to 40%. By day 90 we were at 22% and landed at 11% after 4 months and never went higher. By month 8 we cancelled the project and the 8 people still using the tool were ok letting it go, feeling it didn't help that much. All because someone from the board said, "we need to use AI, anyone not using AI in a year will be out of business." The CEO asked what we should use it for, and the board member said, "I have no idea, that's your job. But we need AI somewhere. Look here, it can buy a plane ticket for me now!" and then wasted the next 40 minutes of the meeting talking about how amazing AI agents were. We're not a tech company, he was definitely NOT a tech person.
- MrDarcy 1y agoIt’s interesting. On the one hand you’re clearly right. On the other hand though, with hindsight, imagine the board member saying the same thing about the PC, the internet, mobile computing, cloud computing… I think both of you are right and it’s only a matter of timing. Time will tell.
- EcommerceFlow 1y agoThe main problem is that Ai "intelligence" has vastly outpaced the associated tooling.
- softwaredoug 1y agoTo me this is an indictment of the leadership style of the day of charging in, laying everyone off, then putting you on an AI death march project. That just destroys institutional knowledge, your credibility as a leader, while inevitably the project fails (and few on the team believed in it anyway). Sure this type of leadership can work in limited short term circumstances where you have a very clear and meaningful objective. But if you can’t quickly get the team itself to believe in the project - and make it THEIR project not YOUR project - you’re going to fail.
- ChrisArchitect 1y agoRelated: 95% of Companies See 'Zero Return' on $30B Generative AI Spend - https://news.ycombinator.com/item?id=44974104 https://news.ycombinator.com/item?id=44974104 - Aug 2025 (415 comments) 95% of generative AI pilots at companies are failing – MIT report - https://news.ycombinator.com/item?id=44941118 https://news.ycombinator.com/item?id=44941118 - Aug 2025 (167 comments)
- dang 1y agoHere's the list I have - but I think there were others? The AI vibe shift is upon us - https://news.ycombinator.com/item?id=45003052 https://news.ycombinator.com/item?id=45003052 - Aug 2025 (100 comments) 95% of Companies See 'Zero Return' on $30B Generative AI Spend - https://news.ycombinator.com/item?id=44974104 https://news.ycombinator.com/item?id=44974104 - Aug 2025 (415 comments) 95 per cent of organisations are getting zero return from AI according to MIT - https://news.ycombinator.com/item?id=44956648 https://news.ycombinator.com/item?id=44956648 - Aug 2025 (14 comments) 95% of generative AI pilots at companies are failing – MIT report - https://news.ycombinator.com/item?id=44941118 https://news.ycombinator.com/item?id=44941118 - Aug 2025 (167 comments)
- theturtle 1y agoI only read the headline, so my reaction was "they can't even drive cars right yet!!! Now AI is flying airplanes???"
- slowmovintarget 1y agoAm I the only one who feels like adding LLMs to many products is the equivalent of bringing Path of Exile crafting to the real world? All hail RNG?
- aaron695 1y ago[dead]