24 ms·
2025: The Year in LLMs
- AndyNemmity 11mo agoThese are excellent every year, thank you for all the wonderful work you do.
- tkgally 11mo agoSame here. Simon is one of the main reasons I’ve been able to (sort of) keep up with developments in AI. I look forward to learning from his blog posts and HN comments in the year ahead, too.
- password4321 11mo agoDon't forget you can pay Simon to keep up with less! > At the end of every month I send out a much shorter newsletter to anyone who sponsors me for $10 or more on GitHub https://simonwillison.net/about/#monthly https://simonwillison.net/about/#monthly
- th0ma5 11mo ago[flagged]
- waldrews 11mo agoRemember, back in the day, when a year of progress was like, oh, they voted to add some syntactic sugar to Java...
- throwup238 11mo ago> they voted to add some syntactic sugar to Java... I remember when we just wanted to rewrite everything in Rust. Those were the simpler times, when crypto bros seemed like the worst venture capitalism could conjure.
- OGEnthusiast 11mo agoCrypto bros in hindsight were so much less dangerous than AI bros. At least they weren't trying to construct data centers in rural America or prop up artificial stocks like $NVDA.
- quaintpartridge 11mo agoThey were, just not as many. https://www.wired.com/story/the-worlds-biggest-bitcoin-mine-is-rattling-this-texas-oil-town/ https://www.wired.com/story/the-worlds-biggest-bitcoin-mine-...
- SauntSolaire 11mo agoInstead they were building crypto mining warehouses in rural America and propping up artificial currencies like BTC.
- zahlman 11mo agoSpeaking of which, we never found out the details (strike price/expiration) of Michael Burry's puts, did we? It seems he could have made bank if he'd waited one more month...
- 11mo ago
- nrhrjrjrjtntbt 11mo agoMore like 6 different new nosql databases and js frameworks.
- dotancohen 11mo agoA Wordpress zero day and Linux not on the desktop. Netcraft confirms it.
- crystal_revenge 11mo agoThat must have been a long time back. Having lived through the time when web pages were served through CGI and mobile phones only existed in movies, when SVMs where the new hotness in ML and people would write about how weird NNs were, I feel like I've seen a lot more concrete progress in the last few decades than this year. This year honestly feels quite stagnant. LLMs are literally technology that can only reproduce the past. They're cool, but they were way cooler 4 years ago. We've taken big ideas like "agents" and "reinforcement learning" and basically stripped them of all meaning in order to claim progress. I mean, do you remember Geoffrey Hinton's RBM talk at Google in 2010? [0] That was absolutely insane for anyone keeping up with that field. By the mid-twenty teens RBMs were already outdated. I remember when everyone was implementing flavors of RNNs and LSTMs. Karpathy's character 2015 RNN project was insane [1]. This comment makes me wonder if part of the hype around LLMs is just that a lot of software people simply weren't paying attention to the absolutely mind-blowing progress we've seen in this field for the last 20 years. But even ignoring ML, the world's of web development and mobile application development have gone through incredible progress over the last decade and a half. I remember a time when JavaScript books would have a section warning that you should never use JS for anything critical to the application. Then there's the work in theorem provers over the last decade... If you remember when syntactic sugar was progress, either you remember way further back than I do, or you weren't paying attention to what was happening in the larger computing world. 0. https://www.youtube.com/watch?v=VdIURAu1-aU https://www.youtube.com/watch?v=VdIURAu1-aU 1. https://karpathy.github.io/2015/05/21/rnn-effectiveness/ https://karpathy.github.io/2015/05/21/rnn-effectiveness/
- handoflixue 11mo ago> LLMs are literally technology that can only reproduce the past. Funny, I've used them to create my own personalized text editor, perfectly tailored to what I actually want. I'm pretty sure that didn't exist before. It's wild to me how many people who talk about LLM apparently haven't learned how to use them for even very basic tasks like this! No wonder you think they're not that powerful, if you don't even know basic stuff like this. You really owe it to yourself to try them out.
- 11mo ago
- odiroot 11mo agoI'm very relieved we've moved away from rewriting everything in Rust.
- jll29 11mo agoThere's no reason not to use Rust for LLM-generated code in the longer term (other than lack of Rust code to learn from in the shorter term). The stricter typing of Rust would make sematic errors in generated code come out more quickly than in e.g. Python because using static typing the chances are that some of the semantic errors are also type violations.
- yencabulator 10mo ago> (other than lack of Rust code to learn from in the shorter term) FWIW Claude Code is quite good at writing Rust, and Claude and Gemini are both surprisingly good at explaining complex third-party Rust libraries.
- michaelcampbell 11mo agoHave we though? I'm glad we're not shouting about it from the rooftops like it's some magical "win" button as much, but TBH the things I use routinely that HAVE been rewritten in rust are generally much better. That could also just be because they're newer and have the errors of the past to not repeat.
- sanreau 11mo ago> Vendor-independent options include GitHub Copilot CLI, Amp, OpenHands CLI, and Pi ...and the best of them all, OpenCode[1] :) [1]: https://opencode.ai https://opencode.ai
- simonw 11mo agoGood call, I'll add that. I think I mentally scrambled it with OpenHands.
- the_mitsuhiko 11mo agoThanks for adding pi to it though :)
- nineteen999 11mo agoHow did I miss this until now! Thank you for sharing.
- logicprog 11mo agoI don't know why you're downloaded, OpenCode is by far the best.
- d4rkp4ttern 11mo agoCan OpenCode be used with the Claude Max or ChatGPT Pro subscriptions, i.e., without per-token API charges?
- simonw 11mo agoApparently it does work with Claude Max: https://opencode.ai/docs/providers/#anthropic https://opencode.ai/docs/providers/#anthropic I don't see a similar option for ChatGPT Pro. Here's a closed issue: https://github.com/sst/opencode/issues/704 https://github.com/sst/opencode/issues/704
- williamstein 11mo agoThere's a plugin that evidently supports ChatGPT Pro with Opencode: https://github.com/sst/opencode/issues/1686#issuecomment-3499864881 https://github.com/sst/opencode/issues/1686#issuecomment-349...
- the_mitsuhiko 11mo ago> The (only?) year of MCP I like to believe, but MCP is quickly turning into an enterprise thing so I think it will stick around for good.
- simonw 11mo agoI think it will stick around, but I don't think it will have another year where it's the hot thing it was back in January through May.
- Alex-Programs 11mo agoI never quite got what was so "hot" about it. There seems to be an entire parallel ecosystem of corporates that are just begging to turn AI into PowerPoint slides so that they can mould it into a shape that's familiar.
- 9dev 11mo agoOne reason may be that it makes it a lot easier to open up a product to AI. Instead of adding a bad ChatGPT UI clone into your app, you inverse control and let external AI tools interact with your application and its data, thus giving your customers immediate benefits, while simultaneously sating your investors/founders/managers desire to somehow add AI.
- nrhrjrjrjtntbt 11mo agoMCP or skills? Can a skill negate the need for MCP. In addition there was a YC startup who is looking at searching docs for LLMs or similar. I think MCP may be less needed once you have skills, openapi specs, and other things that LLMs can call directly.
- MitziMoto 11mo agoMCP isn't going anywhere. Some developers can't seem to see past their terminal or dev environment when it comes to MCP. Skills, etc do not replace MCP and MCP is far more than just documentation searching. MCP is a great way for an LLM to connect to an external system in a standardized way and immediately understand what tools it has available, when and how to use them, what their inputs and outputs are,etc. For example, we built a custom MCP server for our CRM. Now our voice and chat agents that run on elevenlabs infrastructure can connect to our system with one endpoint, understand what actions it can take, and what information it needs to collect from the user to perform those actions. I guess this could maybe be done with webhooks or an API spec with a well crafted prompt? Or if eleven labs provided an executable environment with tool calling? But at some point you're just reinventing a lot of the functionality you get for free from MCP, and all major LLMs seem to know how to use MCP already.
- npalli 11mo agoGreat summary of the year in LLMs. Is there a predictions (for 2026) blogpost as well?
- simonw 11mo agoGiven how badly my 2025 predictions aged I'm probably going to sit that one out! https://simonwillison.net/2025/Jan/10/ai-predictions/ https://simonwillison.net/2025/Jan/10/ai-predictions/
- DANmode 11mo agoDon’t be a bad sport, now!!
- zahlman 11mo agoMaking predictions is useful even when they turn out very wrong. Consider also giving confidence levels, so that you can calibrate going forward.
- jjude 11mo agoI use predictions to prepare rather than to plan. Planing depends on deterministic view of the future. I used to plan (esp annual plans) until about 5 years. Now I scan for trends and prepare myself for different scenarios that can come in the future. Even if you get it approximately right, you stand apart. For tech trends, I read Simon, Benedict Evans, Mary Meeker etc. Simon is in a better position make these predictions than anyone else having closely analyzed these trends over the last few years. Here I wrote about my approach: https://www.jjude.com/shape-the-future/ https://www.jjude.com/shape-the-future/
- deleted 11mo ago[deleted]
- skydhash 11mo ago[flagged]
- MattRix 11mo ago[flagged]
- skydhash 11mo agoWhy do people assume negative critique is ignorance?
- dmd 11mo agoPeople denied that bicycles could possibly balance even as others happily pedaled by. This is the same thing.
- measurablefunc 11mo agoBicycles don't balance, the human on the bicycle is the one doing the balancing.
- moralestapia 11mo ago[flagged]
- dmd 11mo agoYes, that is the analogy I am making. People argued that bicycles (a tool for humans to use) could not possibly work - even as people were successfully using them.
- measurablefunc 11mo agoPeople use drugs as well but I'm not sure I'd call that successful use of chemical compounds without further context. There are many analogies one can apply here that would be equally valid.
- castwide 11mo ago[flagged]
- aussieguy1234 11mo ago> The year of YOLO and the Normalization of Deviance # On this including AI agents deleting home folders, I was able to run agents in Firejail by isolating vscode (Most of my agents are vscode based ones, like Kilo Code). I wrote a little guide on how I did it https://softwareengineeringstandard.com/2025/12/15/ai-agents-firejail-sandbox/ https://softwareengineeringstandard.com/2025/12/15/ai-agents... Took a bit of tweaking, vscode crashing a bunch of times with not being able to read its config files, but I got there in the end. Now it can only write to my projects folder. All of my projects are backed up in git.
- NitpickLawyer 11mo agoI have a bunch of tabs opened on this exact topic, so thank you for sharing. So far I've been using devcontainers w/ vscode, and mostly having a blast with it. It is a bit awkward since some extensions need to be installed in the remote env, but they seem to play nicely after you have it setup, and the keys and stuff get populated so things like kilocode, cline, roo work fine.
- deleted 11mo ago[deleted]
- agentifysh 11mo agoWhat an amazing progress in just short time. The future is bright! Happy New Year y'all!
- sho_hn 11mo agoNot in this review: Also the record year in intelligent systems aiding in and prompting human users into fatal self-harm. Will 2026 fare better?
- simonw 11mo agoI really hope so. The big labs are (mostly) investing a lot of resources into reducing the chance their models will trigger self-harm and AI psychosis and suchlike. See the GPT-4o retirement (and resulting backlash) for an example of that. But the number of users is exploding too. If they make things 5x less likely to happen but sign up 10x more people it won't be good on that front.
- celdon25 11mo agoHow does a model “trigger” self-harm? Surely it doesn’t catalyze the dissatisfaction with the human condition, leading to it. There’s no reliable data that can drive meaningful improvement there, and so it is merely an appeasement op. Same thing with “psychosis”, which is a manufactured moral panic crisis. If the AI companies really wanted to reduce actual self harm and psychosis, maybe they’d stop prioritizing features that lead to mass unemployment for certain professions. One of the guys in the NYT article for AI psychosis had a successful career before the economy went to shit. The LLM didn’t create those conditions, bad policies did. It’s time to stop parroting slurs like that.
- falkensmaize 11mo ago‘How does a model “trigger” self-harm?’ By telling paranoid schizophrenics that their mother is secretly plotting against them and telling suicidal teenagers that they shouldn’t discuss their plans with their parents. That behavior from a human being would likely result in jail time.
- measurablefunc 11mo agoThe people working on this stuff have convinced themselves they're on a religious quest so it's not going to get better: https://x.com/RobertFreundLaw/status/2006111090539687956 https://x.com/RobertFreundLaw/status/2006111090539687956
- websiteapi 11mo agoI'm curious how all of the progress will be seen if it does indeed result in mass unemployment (but not eradication) of professional software engineers.
- simonw 11mo agoI nearly added a section about that. I wanted to contrast the thing where many companies are reducing junior engineering hires with the thing where Cloudflare and Shopify are hiring 1,000+ interns. I ran out of time and hadn't figured out a good way to frame it though so I dropped it.
- ori_b 11mo agoMy prediction: If we can successfully get rid of most software engineers, we can get rid of most knowledge work. Given the state of robotics, manual labor is likely to outlive intellectual labor.
- beardedwizard 11mo ago"Given the state of robotics" reminds me a lot of what was said about llms and image/video models over the past 3 years. Considering how much llms improved, how long can robotics be in this state? I have to think 3 years from now we will be having the same conversation about robots doing real physical labor. "This is the worst they will ever be" feels more apt.
- deleted 11mo ago[deleted]
- chii 11mo agobut robotics had the means to do majority of the physical labour already - it's just not worth the money to replace humans, as human labour is cheap (and flexible - more than robots). With knowledge work being less high-paying, physical labour supply should increase as well, which drops their price. This means it's actually less likely that the advent of LLM will make physical labour more automated.
- DrewADesign 11mo agoYou’re absolutely right! You astutely observed that 2025 was a year with many LLMs and this was a selection of waypoints, summarized in a helpful timeline. That’s what most non-tech-person’s year in LLMs looked like. Hopefully 2026 will be the year where companies realize that implementing intrusive chatbots can’t make better ::waving hands:: ya know… UX or whatever. For some reason, they think its helpful to distractingly pop up chat windows on their site because their customers need textual kindergarten handholding to … I don’t know… find the ideal pocket comb for their unique pocket/hair situation, or had an unlikely question about that aerosol pan release spray that a chatbot could actually answer. Well, my dog also thinks she’s helping me by attacking the vacuum when I’m trying to clean. Both ideas are equally valid. And spending a bazillion dollars implementing it doesn’t mean your customers won’t hate it. And forcing your customers into pathways they hate because of your sunk costs mindset means it will never stop costing you more money than it makes. I just hope companies start being honest with themselves about whether or not these things are good, bad, or absolutely abysmal for the customer experience and cut their losses when it makes sense.
- Night_Thastus 11mo agoThey need to be intrusive and shoved in your face. This way, they can say they have a lot of people using them, which is a good and useful metric.
- ronsor 11mo ago> For some reason, they think its helpful to distractingly pop up chat windows on their site... Companies have been doing this "live support" nonsense far longer than LLMs have been popular.
- DrewADesign 11mo agoThere was also source point pollution before the Industrial Revolution. Useless, forced, irritating chat was ‘nowhere close’ to as aggressive or pervasive as it is now. It used to be a niche feature of some CRMs and now it’s everywhere. I’m on LinkedIn Learning digging into something really technical and practical and it’s constantly pushing the chat fly out with useless pre-populated prompts like “what are the main takeaways from this video.” And they moved their main page search to a little icon on the title bar and sneakily now what used to be the obvious, primary central search field for years sends a prompt to their fucking chatbot.
- techpression 11mo agoNothing about the severe impact on the environment, and the hand waviness about water usage hurt to read. The referenced post was missing every single point about the issue by making it global instead of local. And as if data center buildouts are properly planned and dimensioned for existing infrastructure… Add to this that all the hardware is already old and the amount of waste we’re producing right now is mind boggling, and for what, fun tools for the use of one? I don’t live in the US, but the amount of tax money being siphoned to a few tech bros should have heads rolling and I really don’t want to see it happening in Europe. But I guess we got a new version number on a few models and some blown up benchmarks so that’s good, oh and of course the svg images we will never use for anything.
- simonw 11mo ago"Nothing about the severe impact on the environment" I literally said: "AI data centers continue to burn vast amounts of energy and the arms race to build them continues to accelerate in a way that feels unsustainable." AND I linked to my coverage from last year, which is still true today (hence why I felt no need to update it): https://simonwillison.net/2024/Dec/31/llms-in-2024/#the-environmental-impact-got-better https://simonwillison.net/2024/Dec/31/llms-in-2024/#the-envi...
- jennyholzer3 10mo agoDo you think anything should be done about this environmental impact? Or should we just keep chugging along as though there is no problem at all?
- simonw 10mo agoI think we should continue to find ways to serve this stuff more efficiently - already a big focus of the AI labs because they like making money, and reduced energy bills = more profitable inference. I also think we should use tax policy to provide financial incentives to reduce the environmental impact - tax breaks for renewables, tax hikes for fossil fuel powered data centers, that kind of thing.
- smileson2 11mo agoforgot to mention the first murder-suicide instigated by chatgpt
- DANmode 11mo agoThese are his highlights as a killer blogger, not AI’s highlights. Easy with the hot take.
- deleted 11mo ago[deleted]
- jennyholzer3 10mo agocorrection: the first murder-suicide instigated by chatgpt on record
- didip 11mo agoIndeed. I don't understand why Hacker News is so dismissive about the coming of LLMs, maybe HN readers are going through 5 stages of grief? But LLM is certainly a game changer, I can see it delivering impact bigger than the internet itself. Both require a lot of investments.
- cebert 11mo agoMany people feel threatened by the rapid advancements in LLMs, fearing that their skills may become obsolete, and in turn act irrationally. To navigate this change effectively, we must keep open minds, keep adaptable, and embrace continuous learning.
- nickphx 11mo agorapid advancements in what? hallucinations..? FOMO marketing? certainly nothing productive.
- chii 11mo ago> in turn act irrationally it isn't irrational to act in self-interest. If LLM threatens someone's livelihood, it matters not that it helps humanity overall one bit - they will oppose it. I don't blame them. But i also hope that they cannot succeed in opposing it.
- Davidzheng 11mo agoIt's irrational to genuinely hold false beliefs about capabilities of LLMs. But at this point I assume around half of the skeptics are emotionally motivated anyway.
- jdhsgsvsbzbd 11mo agoAs opposed to having skin in the game for llms and are blind to their flaws??? I'd assume that around half of the optimists are emotionally motivated this way.
- 10mo ago
- syndacks 11mo ago[dupe]
- justatdotin 11mo ago[flagged]
- simonw 11mo agoGot a good news story about that one? I'm always interested in learning more about this issue, especially if it credibly counters the narrative that the issue is overblown.
- justatdotin 11mo ago[flagged]
- simonw 11mo agoWhat's not credible about Andy Masley's work on this? (For anyone else reading this thread: my comment originally just read "Got a good news story about that one?" - justatdotin posted this reply while I was editing the comment to add the extra text.)
- dang 11mo agoI'm not sure what the issue is here but it's not ok to cross into personal attack on HN. We ban accounts that do that, so please don't do it again. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- justatdotin 11mo agohow is that a personal attack? a personal attack would be eg calling him a DC. all I did was point out the intellectual dishonesty of his argument. that's an attack on his intellectually dishonest argument, not his person. by all means go ahead and ban me
- dang 11mo ago"I will not pretend you are engaging honestly" is well into the realm of personal attack, and you can't do that here. Ditto for "I am very disappointed about your BULLSHIT" in the GP comment.
- syndacks 11mo agoI can’t get over the range of sentiment on LLMs. HN leans snake oil, X leans “we’re all cooked” —- can it possibly be both? How do other folks make sense of this? I’m not asking for a side, rather understanding the range. Does the range lead you to believe X over Y?
- zahlman 11mo agoI'm not really convinced that anywhere leans heavily towards anything; it depends which thread you're in etc. It's polarizing because it represents a more radical shift in expected workflows. Seeing that range of opinions doesn't really give me a reason to update, no. I'm evaluating based on what makes sense when I hear it.
- thisoneisreal 11mo agoMy take (no more informed than anyone else's) is that the range indicates this is a complex phenomenon that people are still making sense of. My suspicion is that something like the following is going on: 1. LLMs can do some truly impressive things, like taking natural language instructions and producing compiling, functional code as output. This experience is what turns some people into cheerleaders. 2. Other engineers see that in real production systems, LLMs lack sufficient background / domain knowledge to effectively iterate. They also still produce output, but it's verbose and essentially missing the point of a desired change. 3. LLMs also can be used by people who are not knowledgeable to "fake it," and produce huge amounts of output that is basically besides-the-point bullshit. This makes those same senior folks very, very resentful, because it wastes a huge amount of their time. This isn't really the fault of the tool, but it's a common way the tool gets used and so it gets tarnished by association. 4. There is a ridiculous amount of complexity in some of these tools and workflows people are trying to invent, some of which is of questionable value. So aside from the tools themselves people are skeptical of the people trying to become thought leaders in this space and the sort of wild hacks they're coming up with. 5. There are real macro questions about whether these tools can be made economical to justify whatever value they do produce, and broader questions about their net impact on society. 6. Last but not least, these tools poke at the edges of "intelligence," the crown jewel of our species and also a big source of status for many people in the engineering community. It's natural that we're a little sensitive about the prospect of anything that might devalue or democratize the concept. That's my take for what it's worth. It's a complex phenomenon that touches all of these threads, so not only do you see a bunch of different opinions, but the same person might feel bullish about one aspect and bearish about another.
- _zagj 11mo ago[flagged]
- simonw 11mo agoProbably because my content gets a lot more upvotes than it does flags. If this post was by anyone other than me would you have any problems with its quality?
- dang 11mo agoHe's one of the most valuable writers on LLMs, which are one of the major topics at present. That's not spam.
- _zagj 11mo ago> He's one of the most valuable writers on LLMs Is he, really? Most of his blog posts are little more than opportunistic, buttressing commentary on someone else's blog post or article, often with a bit of AI apologia sprinkled in (for example, marginalizing people as paranoid for not taking AI companies at their word that they aren't aggressively scraping websites in violation of robots.txt, or exfiltrating user data in AI-enbaled apps). EDIT: and why must he link to his blog so often in his comments? How is that not SEO/engagement farming? BTW dang, I wasn't insinuating the mods were in league with him or anything, just that, IMO, he's long past the point at which good faith should no longer be assumed.
- simonw 11mo agoIf you're not assuming good faith what are you assuming here? What's my motivation? "buttressing commentary on someone else's blog post" That's how link blogs work. I wrote more about my approach to that here: https://simonwillison.net/2024/Dec/22/link-blog/ https://simonwillison.net/2024/Dec/22/link-blog/ (And yes, there I go again linking to something I've written from a comment. It's entirely relevant to the point I am making here. That's why I have a blog - so I can put useful information in one place.) I'll also note that I don't ever share links to my link blog posts on Hacker News myself - I don't think they're the right format for a HN post. I can't help if other people share them here: https://news.ycombinator.com/from?site=simonwillison.net https://news.ycombinator.com/from?site=simonwillison.net
- vanderZwan 11mo agoSpeaking of new year and AI: my phone just suggested "Happy Birthday!" as the quick-reply to any "Happy New Year!" notification I got in the last hours. I'm not too worried about my job just yet.
- pants2 11mo agoIt won't help to point out the worst examples. You're not competing with an outdated Apple LLM running on a phone. You're competing with Anthropic frontier models running on a multimillion dollar rack of servers.
- vanderZwan 11mo agoSounds like I'm much more affordable with better ROI
- deleted 11mo ago[deleted]
- gverrilla 11mo agoThis year I had a spotify and a youtube thing to "recall my year", and it was abolute garbage (30% truth, to be exact). I think they're doing it more like an exercise to build up systems, infra, processes, people, etc - it's already clear they don't actually care about users.
- ogou 11mo agoThis is a good tooling survey of the past year. I have been watching it as a developer re-entering the job market. The job descriptions closely parallel the timeline used in the post. That's bizarre to me because these approaches are changing so fast. I see jobs for "Skill and Langchain experts with production-grade 0>1 experience. Former founders preferred". That is an expertise that is just a few months old and startups are trying to build whole teams overnight with it. I'm sure January and February will have job postings for whatever gets released that week. It's all so many sand castles.
- weatherlite 11mo ago> Skill and Langchain experts with production-grade 0>1 experience. Also , it's just normal backend work - calling a bunch of APIs. What am I missing here?
- walthamstow 11mo agoBuzzwords.
- XenophileJKO 11mo agoThat is like saying training tensorflow models is just calling some APIs. Actually making a system like this work seems easy, but isn't really. (Though with the CURRENT generation or two of models it has gotten "pretty easy" I think. Before that, not so much.)
- weatherlite 11mo agoNo idea about training tenserflow models - is it super complex or is it just calling a couple of APIs ? Langchain is literally calling an API. Maybe you need to get good with prompting or whatever, but I don't see where the complexity lies. Please let me know.
- andy99 11mo agoHaving used both Tensorflow (though I expect they mean PyTorch which is way more popular, and I have also used) and langchain, they are nothing alike. They he ML frameworks are much closer to implementing the mathematics of neural networks, with some abstractions but much closer to the linear algebra level. It requires an understanding of the underlying theory. Langchain is a suite of convenience functions for composing prompts to LLMs. I wouldn’t consider there to be some real domain knowledge one would need to use it. There is a learning curve but it’s about learning the different components rather than learning a whole new academic discipline.
- blutoot 11mo agoI hope 2026 will be the year when software engineers and recruiters will stop the obsession with leetcode and all other forms of competitive programming bullshit
- jennyholzer3 10mo agoThanks to Klaude Kode it'll be at least another 20 years of this. If you don't make software developers prove their literacy you will get burned.
- andrewinardeer 11mo agoThank you. Enjoyed this read. AI slop videos will no doubt get longer and "more realistic" in 2026. I really hope social media companies plaster a prominent banner over them which screams, "Likely/Made by AI" and give us the option to automatically mute these videos from our timeline. That would be the responsible thing to do. But I can't see Alphabet doing that on YT, xAI doing that on X or Meta doing that on FB/Insta as they all have skin in the video gen game.
- sexy_seedbox 11mo agoFor image generation, it's already too realistic with Z-Image + Custom LoRas + SeedVR2 upscaling.
- hooverd 11mo agoI do think for the solution of say non-consensual pornography the only solution is incredible violence against people making it.
- compass_copium 11mo ago>I really hope social media companies plaster a prominent banner over them which screams, "Likely/Made by AI" and give us the option to automatically mute these videos from our timeline. They should just be deleted. They will not be, because they clearly generate ad revenue.
- cube00 11mo ago> social media companies plaster a prominent banner over them Not going to happen as the social media companies realise they can sell you the AI tools used to post slop back onto the platform.
- nasnsjdkd 11mo ago[flagged]
- compass_copium 11mo ago>I’m still holding hope that slop won’t end up as bad a problem as many people fear. That's the pure, uncut copium. Meanwhile, in the real world, search on major platforms is so slanted towards slop that people need to specify that they want actual human music: https://old.reddit.com/r/MusicRecommendations/comments/1pq4f1r/instrumental_christmas_music/ https://old.reddit.com/r/MusicRecommendations/comments/1pq4f...
- apolloartemis 11mo agoThank you for your warning about the normalization of deviance. Do you think there will be an AI agent software worm like NotPetya which will cause a lot of economic damage?
- simonw 11mo agoI'm expecting something like a malicious prompt injection which steals API keys and crypto wallets and uses additional tricks to spread itself further. Or targeted prompt injections - like spear phishing attacks - against people with elevated privileges (think root sysadmins) who are known to be using coding agents.
- lukaslalinsky 11mo agoSpeaking of asynchronous agents, what do people use? Claude Code for web is extremely limited, because you have no custom tools. Claude Code in GitHub Actions is vastly more useful, due to the custom environment, but ackward to use interactively. Are there any good alternatives?
- simonw 11mo agoI use Claude Code for web with an environment allowing full internet access, which means it can install extra tools as and when it needs them. I don't run into limits with it very often.
- jimmySixDOF 11mo agoPretty sure next year's wrapup will have "Year of the sub-agent"
- jes5199 11mo agoI'm running Claude Code in a tmux on a VPS, and I'm working on setting up a meta-agent who can talk to me over text messages
- absoluteunit1 11mo agoHey - this sounds like really interesting set-up! Would you be open to providing more details. Would love to hear more, your workflows, etc.
- fullstackchris 11mo agoI just use a couple of custom MCP tools with the standard claude desktop app: https://chrisfrew.in/blog/two-of-my-favorite-mcp-tools-i-use-every-day/ https://chrisfrew.in/blog/two-of-my-favorite-mcp-tools-i-use... IMO this is the best balance of getting agentic work done while having immediate access to anything else you may need with your development process.
- ehsanu1 11mo agoWhat exactly do you mean by custom tools here? Just cli tools accessible to the agent?
- lopatin 11mo agoThe "pelicans on a bike" challenge is pretty wide spread now. Are we sure it's still not being trained on?
- simonw 11mo agoSee https://simonwillison.net/2025/nov/13/training-for-pelicans-riding-bicycles/ https://simonwillison.net/2025/nov/13/training-for-pelicans-... (also in the pelicans section of the post).
- lopatin 11mo ago> All I’ve ever wanted from life is a genuinely great SVG vector illustration of a pelican riding a bicycle. :)
- Razengan 11mo agoMy experience with AI so far: It's still far from "butler" level assistance for anything beyond simple tasks. I posted about my failures to try to get them to review my bank statements [0] and generally got gaslit about how I was doing it wrong, that I if trust them to give them full access to my disk and terminal, they could do it better. But I mean, at that point, it's still more "manual intelligence" than just telling someone what I want. A human could easily understand it, but AI still takes a lot of wrangling and you still need to think from the "AI's PoV" to get the good results. [0] https://news.ycombinator.com/item?id=46374935 https://news.ycombinator.com/item?id=46374935 ---- But enough whining. I want AI to get better so I can be lazier. After trying them for a while, one feature that I think all natural-language As need to have, would be the ability to mark certain sentences as "Do what I say" (aka Monkey's Paw) and "Do what I mean", like how you wrap phrases in quotes on Google etc to indicate a verbatim search. So for example I could say "[[I was in Japan from the 5th to 10th]], identify foreign currency transactions on my statement with "POS" etc in the description" then the part in the [[]] (or whatever other marker) would be literal, exactly as written, but the rest of the text would be up to the AI's interpretation/inference so it would also search for ATM withdrawals etc. Ideally, eventually we should be able to have multiple different AI "personas" akin to different members of household staff: your "chef" would know about your dietary preferences, your "maid" would operate your Roomba, take care of your laundry, your "accountant" would do accounty stuff.. and each of them would only learn about that specific domain of your life: the chef would pick up the times when you get hungry, but it won't know about your finances, and so on. The current "Projects" paradigm is not quite that yet.
- ksec 11mo agoAll these improvement in a single year, 2025. While this may seem obvious to those who follows along the AI / LLM news. It may be worth pointing out again ChatGPT was introduced to us in November 2022. I still dont believe AGI, ASI or Whatever AI will take over human in short period of time say 10 - 20 years. But it is hard to argue against the value of current AI, which many of the vocal critics on HN seems to have the opinion of. People are willing to pay $200 per month, and it is getting $1B dollar runway already. Being more of a Hardware person, the most interesting part to me is the funding of all the developments of latest hardware. I know this is another topic HN hate because of the DRAM and NAND pricing issue. But it is exciting to see this from a long term view where the pricing are short term pain. Right now the industry is asking, we have together over a trillion dollar to spend on Capex over the next few years and will even borrow more if it needs to be, when can you ship us 16A / 14A / 10A and 8A or 5A, LPDDR6, Higher Capacity DRAM at lower power usage, better packaging, higher speed PCIe or a jump to optical interconnect? Every single part of the hardware stack are being fused with money and demand. The last time we have this was Post-PC / Smartphone era which drove the hardware industry forward for 10 - 15 years. The current AI can at least push hardware for another 5 - 6 years while pulling forward tech that was initially 8 - 10 years away. I so wished I brought some Nvidia stock. Again, I guess no one knew AI would be as big as it is today, and it is only just started.
- coffeebeqn 11mo agoSeems like Nvidia will be focusing on the super beefy GPUs and leaving the consumer market to a smaller player
- mrheosuper 11mo agoI'm not against AI/LLM(in fact, i am quite supportive to it). But one of my biggest fear is overusing AI. We may introduce some tool that only "AI/LLM" can resonably do(Like tool with weird, convoluted UI/UX, syntax) and no one against it because AI/LLM can use/interact. Then genAI, It's become more and more difficult to tell which is AI and which is not, and AI is in everywhere. I dont know what to think about it. "If you can't tell, does it matter ?"
- netdur 11mo agoi think the concern about software shifting toward ai design ignores that the web hasn't been human-first for a long time. most traffic is already machine to machine, like crawlers and ci pipelines. we’ve tolerated systems that are barely legible for years. anyone who has grepped through android studio logs knows that human readability is usually a tertiary goal at best. ai interacting with complex systems is just an evolution of the glue code we’ve always written. as for who made it, utility usually matters more than where it came from. i used an agent for an oss changelog recently and it picked up things i’d forgotten while structuring the narrative better than i could. the intent and code were mine, but the ai acted as a high fidelity compressor. the risk isn't ai being everywhere. it’s the atrophy of judgment where we stop using it to support decisions and start using it to outsource thinking.
- jama211 11mo agoThe difference between the performance of models between 2024 and 2025 has been so stark, that graph really shows it. There are still many people on these forums who seem to think AI’s produce terrible code unless ultra supervised, and I can’t help but suspect some of them tried it a little while ago and just don’t understand how different it is now compared to even quite recently.
- Madmallard 11mo agoI used Gemini Pro, Claude Pro yesterday a couple of dozen times and basically have been daily. I have a project to convert my multiplayer XNA game from C# to Javascript and to add networking to the game-play using LLMs. They are far worse at it now than they were a year ago. They actually implemented the requirements (Though inaccurately) to the best of their ability a year ago. Especially Gemini. Now they don't even come remotely close to implementing just the basic requirements. The thing is, I'm giving them the entirety of the C# source code and spelling out what they should do.
- simonw 11mo agoWeird. I would expect Gemini 3 Pro and Claude Opus 4.5 to run rings around Gemini 1.5 Pro and Claude Sonnet 3.5. How are you running them - regular chat interface or do you have them setup with Claude Code or Gemini CLI?
- Madmallard 11mo agoUsing the chat interface primarily with various prompting strategies. I am considering making a thread where I compel others to attempt to get what I'm trying to get out of it and show me their work. The game is only around 25000-30000 LOC in C#.
- simonw 11mo agoI'd be happy to join such a thread.
- 10mo ago
- andai 11mo agoRe: yolo mode I looked into docker and then realized the problem I'm actually trying to solve was solved in like 1970 with users and permissions. I just made a agent user limited to its own home folder, and added my user to its group. Then I run Claude code etc as the agent user. So it can only read write /home/agent, and it cannot read or write my files. I add myself to agent group so I can read/write the agent files. I run into permission issues sometimes but, it's pretty smooth for the most part. Oh also I gave it root to a $3 VPS. It's so nice having a sysadmin! :) That part definitely feels a bit deviant though!
- jillesvangurp 11mo agoI use a qemu vm for running codex cli in yolo mode and use simple ssh based git operations for getting code in and out of there. Works great. And you can also do fun things like let it loose on multiple git projects in one prompt. The vm can run docker as well which helps with containerized tests and other more complicated things. One thing I've started to observe is that you spend more time waiting for tool execution than for model inference. So having a fast local vm is better than a slower remote one.
- some_developer 11mo agoDocker in docker, with opencode. Opencode plus some scripts on host and in its container works well to run yolo and only see what it needs (via mounting). Has git tools but can't push etc. is thought how to run tests with the special container-in-container setup. Including pre-configured MCPs, skills, etc. The best part is that it just works for everyone on the team, big plus.
- knicholes 11mo agocgroups and namespaces
- staeff777 11mo agoI really like this idea and just tried some steps for myself. create user with homedir: sudo useradd -m agent add myself to agent group: sudo usermod -a -G agent $USER Allow agent group to agent home dir: sudo chmod -R 770 /home/agent Start a new shell with the group (or login/logoff): newgrp agent Now you should be able to change into the agent home. Allow your user to sudo as agent: echo "$USER ALL=(agent) NOPASSWD: ALL" |sudo tee -a /etc/sudoers.d/$USER-as-agent now you can start your agent using sudo: sudo -u agent your_agent works nice.
- yupyupyups 11mo agoLet's talk about the societal cost these models have had on us including their high energy cost and the proliferation of auto-generated slop media used to milk ad revenue, scam people, SEO farm, do propaganda or automate trolling. What about these big corporations collecting an astronomical amount of debt to hoard DRAM and NAND in a way that has crippled the PC market within weeks? And what are they going to do next, put a few dollars in Trump's pocket so that they can rob/loot the US population through bailouts? Who gets to keep all the hardware I wonder? Nvidia, Samsung, SK Hynix and some other voltures I forgot to mention are making serious bank right now.
- jennyholzer3 10mo ago> Who gets to keep all the hardware I wonder? Keep questions like this off of the propaganda thread.
- ashishgupta2209 11mo ago2026: The Year of Robots, note it for next year
- ishashankmi 11mo ago[dead]
- ishashankmi 11mo ago[dead]
- fullstackchris 11mo ago> The reason I think MCP may be a one-year wonder is the stratospheric growth of coding agents. It appears that the best possible tool for any situation is Bash—if your agent can run arbitrary shell commands, it can do anything that can be done by typing commands into a terminal. I push back strongly from this. In the case of the solo, one-machine coder, this is likely the case - if you're exposing workflows or fixed tools to customers / collegues / the web at large via API or similar, then MCP is still the best way to expose it IMO. Think about a GitHub or Jira MCP server - commandline alone they are sure to make mistakes with REST requests, API schema etc. With MCP the proper known commands are already baked in. Remember always that LLMs will be better with natural language than code.
- simonw 11mo agoThe solution to that is Anthropic's Skills. Create a folder called skills/how-to-use-jira Add several Bash scripts with the right curl commands to perform specific actions Add a SKILL.md file with some instructions in how to use those scripts You've effectively flattened that MCP server into some Markdown and Bash, only the thing you have now is more flexible (the coding agent can adapt those examples to cover new things you hadn't thought to tell it) and much more context-efficient (it only reads the Markdown the first time you ask it to do something with JIRA).
- aflukasz 11mo agoBut that moves the burden of maintenance from the provider of the service to its users (and/or partially to intermediary in form of "skills registry" of sorts, which apparently is a thing now). So maybe a hybrid approach would make more sense? Something like /.well-known/skills/README.md exposed and owned by the providers? That is assuming that the whole idea of "skills" makes sense in practice.
- simonw 11mo agoYeah that's true, skill distribution isn't a solved problem yet - MCPs have a URL, which is a great way of making them available for people to start using without extra steps.
- rr808 11mo agoWhat happened to Devin? 2024 it was a leading contender now it isn't even included in the big list of coding agents.
- fullstackchris 11mo agoWasn't it basically revealed as a scam? I remember some article about their fancy demo video being sped up / unfairly cut and sliced etc.
- monkeydust 11mo agohttps://cognition.ai/blog/devin-annual-performance-review-2025#how-we-evaluated-devin https://cognition.ai/blog/devin-annual-performance-review-20...
- ColinEberhardt 11mo agoIt’s still around, and tends to be adopted by big enterprises. It’s generally a decent product, but is facing a lot of equally powerful competition and is very expensive.
- simonw 11mo agoTo be honest that's more because I've never tried it myself, so it isn't really on my radar. I don't hear much buzz about it from the people I pay attention to. I should still give it a go though.
- Gud 11mo agoWhat about self hosting?
- simonw 11mo agoI talked about that in this section https://simonwillison.net/2025/Dec/31/the-year-in-llms/#the-year-local-models-got-good-but-cloud-models-got-even-better https://simonwillison.net/2025/Dec/31/the-year-in-llms/#the-... - and touched on it a bit in the section about Chinese AI labs: https://simonwillison.net/2025/Dec/31/the-year-in-llms/#the-year-of-top-ranked-chinese-open-weight-models https://simonwillison.net/2025/Dec/31/the-year-in-llms/#the-...
- nicos29 11mo ago[dead]
- politelemon 11mo ago> The problem is that the big cloud models got better too—including those open weight models that, while freely available, were far too large (100B+) to run on my laptop. The actual, notable progress will be models that can run reasonably well on commodity, everyday hardware that the average user has. From more accessibility will come greater usefulness. Right now the way I see it, having to upgrade specs on a machine to run local models keeps it in a niche hobbyist bubble.
- timonoko 11mo agoOpenSCAD-coding has improved significantly on all models. Now syntax is always right and they understand the concept of negative space. Only problem is that they don't see connection between form and function. They may make teapot perfectly but don't understand that this form is supposed to contain liquid.
- mark_l_watson 11mo agoThanks Simon, great writeup. It has been an amazing year, especially around tooling (search, code analysis, etc.) and surprisingly capable smaller models.
- huqedato 11mo agoI completely disagree with the idea that 2025 "The (only?) year of MCP." In fact, I believe every year in the foreseeable future will belong to MCP. It is here to stay. MCP was the best (rational, scalable, predictable) thing since LLM madness broke loose.
- mmcnl 11mo agoLet's hope 2026 will also have interesting innovations not related to AI or LLMs.
- spicyusername 11mo ago2025 had plenty of those, they just didn't get as many news headlines. One of the difficult things of modernity is that it's easy to confuse what you hear about a lot with what is real. One of the great things about modernity is that progress continues, whether we know about it or not.
- hindustanuday 11mo ago[dead]
- _pdp_ 11mo agoWith everything that we have done so far (our company) I believe by end of 2026 our software will be self improving all the time. And no it is not AI slop and we don't vibe code. There are a lot of practical aspects of running software and maintaining / improving code that can be done well with AI if you have the right setup. It is hard to formulate what "right" looks like at this stage as we are still iterating on this as well. However, in our own experiments we can clearly see dramatic increases in automation. I mean we have agents working overnight as we sleep and this is not even pushing the limits. We are now wrapping major changes that will allows us to run AI agents all the time as long as we can afford them. I can even see most of these materialising in Q1 2026. Fun times.
- papacj657 11mo agoWhat exactly are your agents doing overnight? I often hear folks talk about their agents running for long periods of time but rarely talk about the outcomes they're driving from those agents.
- _pdp_ 11mo agoWe have a lot of grunt work scheduled overnight like finding bugs, creating tests where we don’t have good coverage or where we can improve, integrations, documentation work, etc. Not everything gets accepted. There is a lot of work that is discarded and much more pending verification and acceptance. Frankly, and I hope I don’t come as alarmist (judge for yourself from my previous comments on Hn and Reddit) we cannot keep up with the output! And a lot of it is actually good and we should incorporate it even partially. At the moment we are figuring out how to make things more autonomous while we have the safety and guardrails in place. The biggest issue I see at this stage is how to make sense of it all as I do not believe we have the understanding of what is happening - just the general notion of it. I truly believe that we will reach the point where ideas matter more than execution, which what I would expect to be the case with more advanced and better applied AI.
- asgR1t 11mo agoMost LLMs got worse in 2025. Only addicts and the type of computer gamer that feels drawn to complex setups, gamification and does not care about the end result will feel positive about the grift. 2025: The Year in Open Source? Nothing, all resources were tied up to debunk a couple of Python web developers who pose as the ultimate experts in LLMs.
- simonw 11mo agoIn what way did they get worse? I made you a dashboard of my 2025 writing about open-source that didn't include AI: https://simonwillison.net/dashboard/posts-with-tags-in-a-year/?tags=open-source&year=2025&exclude=ai https://simonwillison.net/dashboard/posts-with-tags-in-a-yea...
- icapybara 11mo agoIt was the year of Claude Code
- nativeit 11mo agoBetween the people with invested and/conflicting interests, and the hordes of dogmatic zealots, I find discussions about AI to be the least productive or reliably informed on HN.
- simonw 11mo agoHonestly this thread was pretty disappointing. Many of the comments here could have been attached to any post about LLMs in the past year or so.
- ck2 11mo agoas I was clicking "gee I hope there's the year of pelicans riding bicycles" left satisfied, lol
- losvedir 11mo agoI predict 2026 will be the year of the first AI Agent "worm" (or virus?). Kind of like the Morris worm running amok as an experiment gone wrong, I think we will sometime soon have someone set up an AI agent whose core loop is to try to propagate itself, either as an experiment or just for the lulz. The actual Agent payload would be very small, likely just a few hundred line harness plus system prompt. It's just a question of whether the agent will be skilled enough to find vulnerabilities to propagate. The interesting thing about an AI worm is that it can use different tricks on different hosts as it explores its own environment. If a pure agent worm isn't capable enough, I could see someone embedding it on top of a more traditional virus. The normal virus would propagate as usual, but it would also run an agent to explore the system for things to extract or attack, and to find easy additional targets on the same internal network. A main difference here is that the agents have to call out to a big SotA model somewhere. I imagine the first worm will simply use Opus or ChatGPT with an acquired key, and part of it will be trying to identify (or generate) new keys as it spreads. Ultimately, I think this worm will be shut down by the model vendor, but it will have to have made a big enough splash beforehand to catch their attention and create a team to identify and block keys making certain kinds of requests. I'd hope OpenAI, Anthropic, etc have a team and process in place already to identify suspicious keys, eg, those used from a huge variety of IPs, but I wouldn't be surprised if this were low on their list of priorities (until something like this hits).
- zerocool86 11mo agoThe "local models got good, but cloud models got even better" section nails the current paradox. Simon's observation that coding agents need reliable tool calling that local models can't yet deliver is accurate - but it frames the problem purely as a capability gap. There's a philosophical angle being missed: do we actually want our coding agents making hundreds of tool calls through someone else's infrastructure? The more capable these systems become, the more intimate access they have to our codebases, credentials, and workflows. Every token of context we send to a frontier model is data we've permanently given up control of. I've been working on something addressing this directly - LocalGhost.ai (https://www.localghost.ai/manifesto https://www.localghost.ai/manifesto) - hardware designed around the premise that "sovereign AI" isn't just about capability parity but about the principle that your AI should be yours. The manifesto articulates why I think this matters beyond the technical arguments. Simon mentions his next laptop will have 128GB RAM hoping 2026 models close the gap. I'm betting we'll need purpose-built local inference hardware that treats privacy as a first-class constraint, not an afterthought. The YOLO mode section and "normalization of deviance" concerns only strengthen this case - running agents in insecure ways becomes less terrifying when "insecure" means "my local machine" rather than "the cloud plus whoever's listening." The capability gap will close. The trust gap won't unless we build for it.
- jennyholzer3 10mo ago[flagged]
- tantony 10mo agoClaude Opus 4.5 has been a big step up for me personally, and I used to think Sonnet 3.5 was good. It is an amazing deal at $20. Just yesterday, it helped me parse out and understand a research paper - complete with step-by-step examples (this one: https://research.nvidia.com/sites/default/files/pubs/2016-03_Single-pass-Parallel-Prefix/nvr-2016-002.pdf https://research.nvidia.com/sites/default/files/pubs/2016-03...). I will now go ahead and implement it myself, possibly relegating some of the more grunt-work type tasks to Claude code. Without it, I would have been struggling through the paper for days, wading through WGSL shader code and there would be a high chance that I just give up on it since this is for a side project and not my $job. It has been a major force multiplier just for learning things. I have had the $20 subscription for about a year now. I bump it up to the $100 plan if I happen to be working on some project that eats through the $20 allocation. This happens to be one such month. I will probably go back to the $20 plan after this month. I continue to get a lot of value out of it.
- rldjbpin 10mo agowhile most of the discourse is around text and (multimodal) LLMs, the past year has been quite interesting in other media as well. i suppose the "slop" section did hint on it briefly. while LLM-generated text was already a thing of the past couple years, this year images and videos had the "AI or not" moment. it appears to have a bigger impact than our myopic world of software. another trend towards the end of the year was around "vibe training" of new (albeit much smaller) AI models. personally, getting up and running with a project has been easier than ever, but unlike OP, i don't share the same excitement to make anymore. perhaps vibe coding with a phone will get more streamlined with a killer app in 2026.