8 ms·
In the long run, LLMs make us dumber
- CuriouslyC 1y agoLLMs haven't made me dumber, but they have made me lazier. I think about writing code by hand now and groan.
- sitzkrieg 1y agothats kinda embarrassing
- CuriouslyC 1y agoWould you groan if you had to take public transit while your car was broken down? If you love to knit that's cool but don't get on me because I'd rather buy a factory sweater and get on with my day. I love creating things, I love solving problems, I love designing elegant systems. I don't love mashing keys.
- blibble 1y agomy public transport is faster and cheaper than driving...
- WD-42 1y agoI love how you immediately go for public transit as an analogy for something regrettable. Fits.
- CuriouslyC 1y agoI put my time in on the city bus brother. In the time that I had the displeasure I had bodily fluids thrown on me and someone almost stabbed me. Maybe you have first class magic fairy busses with plush reclining seats and civil neighbors but that's not the norm.
- WD-42 1y agoI used to take BART into the city for years before I moved away from the bay. Yea, I'd sometimes see a rare scuffle and occasionally there would be someone who smelled like they had shat themselves 3 times living in one of the cars, but overall it was a positive experience. I've never been a more prolific reader than I was during those days. It still blows my mind that I had coworkers who would choose to drive over the bay bridge and get nothing done other than work on their road rage than to take BART. Maybe it was worse where you were.
- EstanislaoStan 1y agoTry public transport in Korea or probably lots of other countries. There's your fairies.
- andrekandre 1y ago> I had bodily fluids thrown on me and someone almost stabbed me. that sucks and i get it, but tbf that sounds like a local community problem not a public transport problem per se
- Avshalom 1y agopublic transit drives you places, it does the work for you, like the llm. biking instead of driving would be a better analogy... which you might have caught if llms hadn't made you dumber.
- scarface_74 1y agoI don’t get paid to “write code”. I use my 30 years of professional industry experience to either make the company money or to save the company money and in exchange for my labor, they put money in my account and formerly RSUs in my brokerage account. It’s not about “passion”. It’s purely transactional and I will use any tool that is available to me to do it. If an LLM can make me more efficient at that so be it. I’m also not spending months getting a server room built out to hold a SAN that can store a whopping 3TB of storage like in 2002. I write 4 lines of Yaml to provision an S3 bucket.
- sys_64738 1y agoHow much of your coding time do you spend writing mundane, repetitive code that should just instantly appear? I think there's a dual benefit of removing the drudgery of that but also gives you more time to write new, interesting code to achieve your goals and priorities sooner.
- nomel 1y agoWait until you hear how code used to be written, and how "lazy" you have it! Everyone, even yourself, enjoys things being easier, when moving towards a solution. Programming is a means to an end, to solve an actual problem.
- pixl97 1y agoWhy? Or are you growing everything you need to eat by yourself? Keep it to programming then, I'm sure you write all your own libraries right? In assembly, that is. Everything about modern life, especially programming is about enabling more with less work.
- gerdesj 1y agoSo how do you interact with your LLM? (by hand perhaps?) I find prompt fettling a great way of getting to grips with a problem. If I can explain my problem effectively enough to get a reasonable start on an answer, then I likely thoroughly understand my problem. An LLM is like a really fancy slide rule or calculator (I own both). It does have a habit of getting pissed and talking bollocks periodically. Mind you, so do I.
- CuriouslyC 1y agoI voice chat with chatgpt to generate a very very detailed architecture document / spec / prd / whatever, in an implementation checklist order, then I take that and save it as a "VISION.md" file in the repo, and queue up a command for the agent to start working on the problem. I have detailed subagent and task forking logic in my claude setup, so I can get plans that involve 7-8 subagents (some being invoked by claude -p for parallel execution) and take a project from that spec to a very real project in ~6-8 hours, during which time my agents will typically phone home to see if they should continue maybe 2 or 3 times (I have anti stopping hooks but they're lazy SoBs).
- cabacon 1y agoPlato's _Phaedrus_ features Socrates arguing against writing; "They will cease to exercise memory because they rely on that which is written, calling things to remembrance no longer from within themselves, but by means of external marks." I have heard people argue that the use of calculators (and later, specifically graphing calculators) would make people worse at math; quick searching found papers like https://files.eric.ed.gov/fulltext/ED525547.pdf https://files.eric.ed.gov/fulltext/ED525547.pdf discussing the topic. I can't see how the "LLMs make us dumber" argument is different than those. I think calculators are a great tool, and people trained in a calculator-having environment certainly seem to be able to do math. I can't see that writing has done anything but improve our ability to reason over time. What makes LLMs different?
- chankstein38 1y agoBecause they do it all for us and they frequently do it wrong. We're not offloading the calculation or the typing to the thing we're using it to solve the whole problem for us. Calculators don't solve problems, they solve equations. Writing didn't kill our memories because there's still so much to remember that we almost have to write things down to be able to retain it. If you don't do your own research and present the LLM with your solution and let it point out errors and instead just type "How do I make ____?" it's solving the entire thought process for you right there. And it may be leading you wrong. That's my view on how it's different at least. They're not calculators or writing. They're text robots that present solutions confidently and offer to do more work immediately afterwards, usually ending a response in "Want me to write you a quick python script to handle that?" A thought experiment, if you're someone who has used a calculator to calculate 20% tips your whole life, try to calculate one without it. Maybe you specifically don't struggle because you're good at math or have a lot of math experience elsewhere but if you have approached it the way this article is calling bad, you'd simply have no clue where to start.
- cabacon 1y agoI guess my point is that the argument being made is "if you lift dumbbells with a forklift, you aren't getting strong by exercising". And that's correct. But that doesn't mean that the existence of forklifts makes us weaker. So, I guess I'm just saying that LLMs are a tool like any other. Their existence doesn't make you worse at what they do unless you forgo thinking when you use them. You can use a calculator to efficiently solve a wrong equation - you have to think about what it is going to solve for you. You can use an LLM to make a bad argument for you - you have to think about the inputs you're going to have it output for you. I was just feeling anti-alarmist-headline - there's no intrinsic reason we'd get dumber because LLMs exist. We could, but I think history has shown that this kind of alarmism doesn't come to fruition.
- blamestross 1y agoIts all about who "us" are. Individuals? Most information technology makes us dumber in isolation, but with the tools we end up net faster. The scary thing is that it is less about making things "better" than it is making them cheaper. AI isn't winning on skill, its winning on being "80% the quality at 20% the price." So if you see "us" as the economic super-organism managed by very powerful people, then it makes us a lot smarter!
- tptacek 1y agoI buy this for writing. There's a very limited set of things GPT is good at for improving my writing (basic sentence voice and structure stuff, overusing words), but mostly I find it makes my writing worse, and I don't trust any argument it makes because, as the post observes, I haven't thought them through and had the opportunity to second-guess them myself. Also it has a high opinion of Bryan Ferry. Deeply untrustworthy. But I don't buy this at all for software development. I find myself thinking more carefully and more expansively, at the same time, about solving programming problems when I'm assisted by an LLM agent, because there's minimal exertion to trying multiple paths out and seeing how they work out. Without an agent, every new function I write is a kind of bet on how the software is going to come out in the end, and like every human I'm loss-averse, so I'm not good at cutting my losses on the bad bets. Agents free me from that.
- chankstein38 1y agoThat's wild. My experience has been vastly different. ChatGPT, Claude, Claude Code, Gemini, etc whatever it may be even the simplest scripts I've had them write usually come out with issues. As far as writing functions is concerned, it's way less risky for me to write functions based on my prior knowledge than to ask ChatGPT to write the entire thing for me and just paste it in and call it good. I do use it for learning and to help me access new concepts I've never thought about but if you're not proving what it's writing yourself and understanding what its written yourself then I hope I never have to work on code you've written. If you are, then you are not doing what the article is talking about.
- tptacek 1y agoI don't know what you're having it write; I mostly have it write Go. When I ask it to write shell scripts, its shell scripts are better than what I would have written (my daily drivers are whatever Sketch.dev is using under the hood --- Claude, I assume --- and Gemini). I've been writing Go since ~2012 and coding since ~1995. I read everything I merge to `main`. The code it produces is solid. I don't know that it one-shots stuff; I work iteratively and don't care enough to try to make it do that, I just care about the endpoint. The outcomes are very good. I know I'm not alone in having this experience.
- dothereading 1y agoI agree with this, but at the same time I think LLMs will make anyone who wants to learn much smarter.
- j45 1y agoIf it's doing the thinking for you, just like social media, but much more intense.
- deepsun 1y agoPlato was against writing, as it makes us dumber. https://fs.blog/an-old-argument-against-writing/ https://fs.blog/an-old-argument-against-writing/
- FollowingTheDao 1y agoSounds like you’re saying this in favor of AI, but I’m taking it as a just favor of both AI and writing.
- neom 1y agoBit tangential, but I find oral traditions really interesting, the sheer scale of what can be done is quite impressive: https://blog.education.nationalgeographic.org/2016/04/08/aboriginal-songlines-helped-draw-the-map-in-australia/ https://blog.education.nationalgeographic.org/2016/04/08/abo... -- https://en.wikipedia.org/wiki/Songline https://en.wikipedia.org/wiki/Songline
- mrec 1y agoI don't think it's too tangential. If you haven't already seen it, I suspect you'd enjoy this; it really made an impact on me when I first read it, especially the ending. https://www.fantasticanachronism.com/p/having-had-no-predecessor-to-imitate https://www.fantasticanachronism.com/p/having-had-no-predece...
- tsongas4 1y agoPhysics agrees with Plato. https://www.scientificamerican.com/article/you-dont-need-words-to-think/ https://www.scientificamerican.com/article/you-dont-need-wor... Not really sure why the geometry and color gradient of the world needs to be captured in a skeletonized syntax and semantics when our body is evolved to experience them directly.
- Refreeze5224 1y agoI imagine his memory and those of people who memorized instead of wrote were better. So by that metric, writing is making people dumber. It's just not all that relevant today, and we don't prioritize memorization to the extent Plate and the ancient Greeks probably did.
- whydoineedthis 1y agoSimilar fear mongering when calculators came about. No one got dumber, we just got faster at doing simple math. WOrking out complex math will always be interesting to those who really want to do it, and the rest likely wont contribute mu ch anyway - thier just consumers. Let the kids have thier wordy calculators, it actually may unblock critical paths of success needed for someone to really go deep.
- BizarroLand 1y agoYep. I force memorized so many calculations because our teachers constantly told us that in the future we wouldn't always have a calculator with us. It was helpful, I got pretty far along in collegiate math without tutors or assistance thanks to the hard calculation skills I drilled into my head. But, counterpoint, if I leave my calculator/computer/all in one everything device at home on any given day it can ruin my entire day. I haven't gone 72 hours without a calculator in nearly a decade.
- BizarroLand 1y agoDumb is more the inability to make expedient, salient, and useful decisions either from the lack of knowledge or the fundamental incapability to process the available knowledge. Dumb is accidental or genetic. AI won't affect how dumb we are. I think they will decrease the utility of crystalline knowledge skills and increase our fluid knowledge skills. Smart people will still find ways to thrive in the environment. Human intelligence will continue moving forward.
- Avshalom 1y agoit made doctors worse at diagnosing cancer and diagnosing is very much "mak[ing] expedient, salient, and useful decisions"
- BizarroLand 1y agoFortunately we also have your reply to exemplify how supposedly smart people can miss the point and make absurd mistakes even without AI to help them.
- codespin 1y agoJust as the engine replaced physical strength, artificial intelligence, through models like large language models, is now replacing cognitive labor and thought. From the article "Muscles grow by lifting weights" yet we do that now as a hobby and not as a critical job. I'm not sure I want to live in a world where thinking is a gym like activity, however if you go back 200 years it would probably be difficult to explain the situation today to someone living in a world where most people are doing physical labor or using animals to do it.
- amdivia 1y agoI doubt that would happen. The engine provides artificial strength, granted, but AI does not provide artificial intelligence. It's a misnomer.
- potsandpans 1y agoThe artificial intelligence doesn't provide artificial intelligence. Ok.
- sn9 1y agoYour confusing the name of a thing with its nature.
- potsandpans 1y agoI don't know about all of that.
- beacon473 1y agoArtificial intelligence doesn't negate the need for human intelligence. The jackhammer replaced the hammer and chisel for busting concrete, and the user's physical strength is important to both the manual and automated tool. AI is a multiplayer to the user's intelligence, as the jackhammer is a multiplayer to physical strength.
- bdhcuidbebe 1y ago
- evanjrowley 1y agoImpressive research but I can't help feeling like it's fundamentally flawed. The analysis considered "essay ownership" a property of LLM, Search, and Brain-Only participants, but what would have been more valuable is flipping all of the graphs based on percieved ownership levels. On average, less LLM users felt a sense of ownership, and this should not surprise anyone. The researchers lumped together people who let LLMs do all of the writing vs using LLMs constructive ways. What would have been more interesting is studying the LLM users who maintained a sense of owership, because then we could learn more way to use LLMs that potentially make us smarter. I also feel like there's more to be said about LLMs fostering the ability to ask questions better than you might if you primarily used search. If the objective was to write, for example, about an esoteric organic chemistry topic, and a "No Brain" group of non-experts was only allowed to formulate a response by asking real-life experts as much as they can about the esoteric topic, then would users more experienced with LLMs come out ahead on the essay score? Understanding how to leverage a tight communication loop most effectively is a skill that the non-LLM groups in this study should be evaluated on.
- hnuser123456 1y agoWhen working well, they enable us to offload needing to memorize a wikipedia worth of information and think about higher level problems. We become more intelligent at higher level solutions. Of course people don't know what was written if they were required to "submit an essay" where the main grade is whether or not they submitted one and the topic may have been one not interesting to them. Ask people to write essays about things they're truly, honestly interested in, and people who have access to an LLM are likely able to enrich their knowledge faster than those without.
- seba_dos1 1y agoDon't forget to make fact checking a part of the evaluation though.
- nateglims 1y agoThe problem is in the chain of learning required to understand or master something. If you offload the foundational things that you learn and chunk you will hinder yourself. We can see this right now in the reading dilemma in US schools where early decoding skills were misunderstood and it lead to significant struggles later.
- blurbleblurble 1y agoI disagree that this is a given. In the long run they just allow us to stay in other levels of abstraction for longer periods of time, whether those be lazy/ignorant or otherwise.
- stevage 1y agoI've been thinking about this a bit in the context of a current, very complex and challenging side project. When I first began, I tried vibe coding the backend, but found the feeling of disconnect from "my" code too uncomfortable so abandoned that approach. I've been relying pretty heavily on ChatGPT to help me learn unfamiliar technologies, but perhaps because of its fallibility with DuckDB, I've been spending a lot of time in the documentation and writing my own queries, and I think I'm going through enough cognitive difficulty to be learning properly. There was one time when I'd spent probably at least a day trying to optimise a query in Postgres (yes, two database technologies, don't ask) without much success, and ChatGPT completely solved it in about 10 minutes. Incredible result, helped me learn some useful techniques. There are so many rabbit holes on this project it's nice not to have to go down every single one by myself. On HN there's often this split between anti-AI and AI evangelists but there really is a lot of space in the middle: judicious use of AI for specific purposes, managing the risks and benefits, etc. (Side note...did the OP really mention the highly discredited broken windows theory?)
- christophilus 1y agoI’ve done something similar recently. AI is really useful at helping me learn the Hare programming language, and some related UNIX stuff I was unfamiliar with. It’s wrong maybe 20% of the time, but that’s often quickly apparent to me (I’m pretty experienced— 25 years in the industry). It also helps me bounce ideas around and consider alternative approaches. I don’t want to go back to a pre-Claude world.
- senectus1 1y agoI use it little more than as a search engine. Did Google and Yahoo make us dumber?
- thefaux 1y agoLike llms, I think google made a small class of people more productive and effective and did indeed make most people dumber and less effective.
- pevansgreenwood 1y ago[dead]
- daddydave 1y agoI have the same hobby of extrapolating my own experience to all of humanity.
- michaelbrave 1y agoKinda, I mean so our brains shift once we are able to write things down instead of having to memorize completely, similarly when the internet happened we now could find answers quickly and stopped remembering or writing down things that were easy to find. So now thinking will shift again, dumber might be the right word, but it might not be, our thinking would shift away from computation type of knowledge and lean more toward making good judgments or having clearer goals type of knowledge.
- aok1425 1y agoDo you think it's like when driving with GPS first became a thing? Everyone stopped learning the roads & streets of where they were driving, but it was OK to lose that knowledge. GPS companies revised their products to adapt to driver mistakes, and today driving is generally better with Google Maps, even though sometimes it can be worse (no internet, or when a bug arises).
- deleted 1y ago[deleted]
- westurner 1y agoCuneiform, chisel, pen, wheel, bicycle, power saw, personal computer, pocket calculator; "Video killed the radio star." What once was! A genius paradise lost to technology once again.