14 ms·
Things we learned about LLMs in 2024
- agentultra 2y agoDon’t forget that 2024 was also a record year for new methane power plant projects. Some 200 new projects in the US alone and I’d wager most of them are funded directly by big tech for AI data centres. https://www.bnnbloomberg.ca/investing/2024/09/16/ai-boom-is-driving-a-surprise-resurgence-of-us-gas-fired-power/ https://www.bnnbloomberg.ca/investing/2024/09/16/ai-boom-is-... This is definitely extending the runway of O&G at a crisis point in the climate disaster when we’re supposed to be reducing and shutting down these power plants. Update: clarified the 200 number is in the US. There are far more world wide.
- api 2y agoThe only thing that will stop this is for battery storage to get cheap and available enough that it can cover for renewables. If we are still building gas turbines it means that hasn’t happened yet. AI is a red herring. If it wasn’t that it would be EV power demand. If it wasn’t that it would be reshoring of manufacturing. If it wasn’t that it would be population growth from immigration. If it wasn’t that it would be replacing old coal power plants reaching EOL. Replacing coal with gas is an improvement by the way. It’s around half the CO2 per kWh, sometimes less if you factor in that gas turbines are often more efficient than aging old coal plants.
- agentultra 2y agoMethane has a shorter half-life than CO2 but is a far worse green house gas; retaining far more heat. And delivering methane leaks like a sieve into the atmosphere from all parts of the process. Sure it’s probably “better than coal,” but not by much. It’s a bit like comparing what’s worse: getting burned by fire or being drowned in acid.
- Nition 2y agoPumped hydro is an excellent form of storage if you have the terrain for it. A whole order of magnitude cheaper than battery storage at the moment.
- ToucanLoucan 2y agoIt would be really cool if big tech could find a new hyperscaler model that didn't also require offsetting the goals of green energy projects worldwide. Between LLM and crypto you'd swear they're trying to find the most energy-wasteful tech possible.
- zachrip 2y agoIt seems odd to put crypto and LLMs in the same boat in this regard - I might be wrong but are there any crypto projects that actually provide value? I'm sure there are ones that do folding or something but among the big ones?
- rileymat2 2y agoValue is a hard term, this link will seem snarky, but: https://www.axios.com/2024/12/25/russia-bitcoin-evade-sanctions-crypto https://www.axios.com/2024/12/25/russia-bitcoin-evade-sancti... So in a way, it is providing value to someone, whether we like it or not. Or Drug Cartels. https://www.context.news/digital-rights/how-crypto-helps-latin-americas-drug-cartels-do-business https://www.context.news/digital-rights/how-crypto-helps-lat... But this is the promise of uncontrollable decentralization providing value, for good or bad?
- blibble 2y agocrypto has real uses, most of them illegal meanwhile "AI" is used to produce infinity+1 pictures of shrimp jesus and more spam than we've ever known before and if we're really lucky, it will put us all out of work
- ben_w 2y agoCryptocurrency, at least PoW, the point is indeed to be the most wasteful — a literal Dyson swarm powered Bitcoin would provide exactly the same utility as the BTC network already had in 2010. LLMs (and the image, sound, and movie generating models) are more coincidentally power-hogs — people are at least trying to make them better at fixed compute, and lower compute at fixed quality.
- comte7092 2y agoEnergy generation methods aren’t fungible. Methane is favored in many cases because they can be quickly ramped up and down to handle momentary peaks in demand or spotty supply generated from renewables. Without knowing more details about those projects it is difficult to make the claim that these plants have anything to do with increased demand due to LLMs, though if anything, they’d just add to base load demands and lead to slower decommissioning of old coal plants like we’ve seen with bitcoin mines.
- throwup238 2y agoMethane is also worth burning to lessen the GHG impact since we produce so much of it as a byproduct of both resource extraction and waste disposal anyway.
- deleted 2y ago[deleted]
- uludag 2y agoBut according to the author, apparently bringing this up isn't helpful criticism. I'm curious what peoples thoughts are of what the future of LLMs would be like if we severely overshoot our carbon goals. How bad would thinks have to get for people to stop caring about this technology?
- simonw 2y agoIt's helpful criticism as part of the conversation. What frustrates me is when people go "LLMs are burning the planet!" and leave it at that.
- agentultra 2y agoIt is a rather contrasting opinion that the trade-offs to have AI aren’t worth the value they bring. The growth in this technology isn’t outpacing car pollution and O&G extraction… yet, but the growth rate has been enough in recent years to put it on the radar of industries to watch out for. I hope the compute efficiencies are rapid and more than commensurate with the rate of growth so that we can make progress on our climate targets. However it seems unlikely to me. It’s been a year of progress for the tech… but also a lot of setbacks for the rest of the world. I’m fairly certain we don’t need AGI to tell us how to cope with the climate crisis; we already have the answer for that. Although if the industry does continue to grow and the efficiency gains aren’t enough… will society/investors be willing to scale back growth in order to meet climate targets (assuming that AI becomes a large enough segment of global emissions to warrant reductions)? Interesting times for the field.
- jmclnx 2y agoInteresting, the article is not quite what I expected.
- _giorgio_ 2y agoThis isn't an airport.
- fosterfriends 2y agoMy fav part of the writeup at the end: """ LLMs need better criticism # A lot of people absolutely hate this stuff. In some of the spaces I hang out (Mastodon, Bluesky, Lobste.rs, even Hacker News on occasion) even suggesting that “LLMs are useful” can be enough to kick off a huge fight. I like people who are skeptical of this stuff. The hype has been deafening for more than two years now, and there are enormous quantities of snake oil and misinformation out there. A lot of very bad decisions are being made based on that hype. Being critical is a virtue. If we want people with decision-making authority to make good decisions about how to apply these tools we first need to acknowledge that there ARE good applications, and then help explain how to put those into practice while avoiding the many unintiutive traps. """ LLMs are here to stay, and there is a need for more thoughtful critique rather than just "LLMs are all slop, I'll never use it" comments.
- vunderba 2y agoI agree, but I think my biggest issue with LLMs (and a lot of GenAI) is that they act as a massive accelerator for the WORST (and unfortunately most common) type of human - the lazy one. The signal-to-noise ratio just goes completely out of control. https://journal.everypixel.com/ai-image-statistics https://journal.everypixel.com/ai-image-statistics
- greenavocado 2y agoExif watermark by the generators would solve 90% of the problem in one fell swoop because lazy people won't remove it
- minimaxir 2y agoEvery image host and social media app automatically strips EXIF data (for privacy reasons at minimum).
- greenavocado 2y agoStenography with a known signature perhaps
- throwanem 2y ago> I’ve heard from sources I trust that both Google Gemini and Amazon Nova charge less than their energy costs for running inference... Then, several headings later: > I have it on good authority that neither Google Gemini nor Amazon Nova (two of the least expensive model providers) are running prompts at a loss. So...which is it?
- simonw 2y agoOh whoops! That's an embarrassing mistake, and I didn't realize I had that point twice. They're not running at a loss. I'll fix that.
- cess11 2y agoIf they are subsidised they can make a profit while still not making enough money to cover energy costs.
- kgwgk 2y agoSubsidised by whom?
- cess11 2y agoE.g. tax payers.
- kgwgk 2y agoAre tax payers subsiding that particular activity of Google or Amazon? If they do, “they make enough money” to cover costs. If they don’t, how does it become profitable if it doesn’t even cover the cost of one of the inputs?
- cess11 2y agoWhere I live corporations like those get to build data centers and energy subsidies from the state, i.e. tax payers pay a part of their energy bills. This isn't money they're making, it's money other people made and gave to them. This means that they could make a profit off inference models without the revenue being large enough to pay the energy costs. If it's the case I don't know. I'm more concerned with getting rid of those corporations altogether since interacting with them is generally forbidden due to the lack of data protection regulations in the US.
- neom 2y ago"learned out about" - is that an Australian phraseology by chance? Sounds Australian or British of some manner.
- simonw 2y agoThat was a very dumb typo in my title!
- neom 2y agoI figured as much, although I wondered if you were going for the kinda "he learn out about not pissing people off real sharpish" kinda tone I've heard in Scotland before, but wasn't sure. Big fan btw, happy new years Simon! :)
- user982 2y agoYou can find out, you can learn about, but you can't learn out about.
- mjburgess 2y agoGood ear -- the use of 'out' as an abbreviation of anything is a britishism. Nowt, owt, -- nothing, anything
- CRConrad 2y agoNaught, aught.
- slyall 2y agoAustralians or Brits would tend so day "learnt" rather than "learned"
- pkoird 2y agoI'd love to read a semi-technical book on everything that we've learned about what works and what does not on LLMs.
- nkingsy 2y agoIt would be out of date in months. Things that didn’t work 6 months ago do now. Things that don’t work now, who knows…
- minimaxir 2y agoThere are still some tropes from the GPT-3 days that are fundamental to the construction of LLMs that affect how they can be used and will not change unless they no longer are trained to optimize for next-token-prediction (e.g. hallucinations and the need for prompt engineering)
- DoctorOetker 2y agoDo you mean performance that was missing in the past is now routinely achieved? Or do you actually mean that the same routines and data that didn't work before suddenly work?
- nkingsy 2y agoB Each new model opens up new possibilities for my work. In a year it's gone from sort of useful but I'd rather write a script, to "gets me 90% of the way there with zero shots and 95% with few-shot"
- Animats 2y ago> Some of those GPT-4 models run on my laptop That's an indication that most business-sized models won't need some giant data center. This is going to be a cheap technology most of the time. OpenAI is thus way overvalued.
- shihab 2y agoThe last OpenAI valuation I read about was 157 billion. I am struggling to understand what justifies this. To me, it feels like OpenAI is at best few months ahead of competitors in some areas. But even if I am underestimating the advantage, it's few years instead of few months, why does it matter? It's not like AI companies are going to enjoy the first-mover advantage internet giants had over the competition.
- throwpoaster 2y ago157 billion implies about a 1% chance at dominating a 1.5 trillion market. Seems reasonable.
- asqueella 2y ago10%, no?
- throwpoaster 2y agoNo, there’s a risk term I’m skipping over.
- airstrike 2y agothat's 10% and who's to say that market is worth 1.5 trillion to begin with
- cloverich 2y agoMarket cap of apple, google, facebook.
- JaDogg 2y agoI think LLM web applications need a big red warning (non interactive, I don't want more cookie dialogs) like in cigarettes. > LLM generated content need to be verified.
- becquerel 2y agoEvery LLM web app I have used has a disclaimer along these lines prominently featured in the UI. Maybe the disclaimer isn't bright red with gifs of flashing alarms, but the warnings are there for the people who would pay attention to them in the first place.
- minimaxir 2y agoUnfortunately, even after 2 years of ChatGPT and countless news stories about it, people still don't realize that LLMs can be wrong. There maybe should be a bright red flashing disclaimer at this point.
- henning 2y agoSpookily good at writing code? LLMs frequently hallucinate broken nonsense shit when I use them. Recognize what they do well (generate simple code in popular languages) while acknowledging where they are weak (non-trivial algorithms, any novel code situation the LLM hasn't seen before, less popular languages).
- simonw 2y agoDid you try learning HOW to get good code out of them? As with all things LLM there's a whole lot of undocumented and under appreciated depth to getting decent results. Code hallucinations are also the least damaging type of hallucinations, because you get fact checking for free: if you run the code and get an error you know there's a problem. A lot of the time I find pasting that error message back into the LLM gets me a revision that fixes the problem.
- lolinder 2y ago> Code hallucinations are also the least damaging type of hallucinations, because you get fact checking for free: if you run the code and get an error you know there's a problem. This is great when the error is a thrown exception, but less great when the error is a subtle logic bug that only strikes in some subset of cases. For trivial code that only you will ever run this is probably not a big deal—you'll just fix it later when you see it—but for code that must run unattended in business-critical cases it's a totally different story. I've personally seen a dramatic increase in sloppy logic that looks right coming from previously-reliable programmers as they've adopted LLMs. This isn't an imaginary threat, it's something I now have to actively think about in code reviews.
- k2xl 2y agoSomething not mentioned is AI generated music. Suno's development this year is impressive. Unclear what this will mean for music artists over next few years.
- simonw 2y agoYeah, this year I decided to just focus on LLMs - I didn't touch on any of the image or music generation advances either. I haven't been following those closely enough to have particularly useful things to say about them.
- fullstackchris 2y agoVery clear; I like buying music produced by people who play instruments.
- janstice 2y agoI’m even happy to listen to generative music, so long as it’s orchestrated (haha) by musicians using musical taste to make musical decisions, rather than a pastiche of the worst derivative house you’ve ever heard by a rando with no intent.
- JaDogg 2y agoWhat you think of samples and FL Studio / DAWs?
- adsharma 2y agoIn spite of all this progress, I can't find LLMs that solve simple tasks like: Here is my resume. Make it look nice (some design hints). They can spit html and css, but not Google doc. On the other hand, Google results are dominated by SEO spam. You can probably find one usable result on page 10. The problem is not technology. It's a business model that can support the humans feeding data into the LLM.
- Alex-Programs 2y agoWhy would they be able to output a Google doc? It's a proprietary format. The closest thing would be rich text format to copy paste.
- vikramkr 2y agoThat proprietary format is owned by a company associated with folks who won two nobel prizes for AI related work this year and the employer at the time of the researchers who wrote the attention is all you need paper and also the owner of a search engine with access to like, all the data. Doesn't seem unreasonable lol
- behnamoh 2y ago[flagged]
- adsharma 2y agoI'll accept any open format that can be lightly edited and converted into PDF. Google doc + PDF is likely the most commonly used combination based on what I see in the SEO spam. Some of them make you watch ads and then allow you to download something that looks like a doc, but you'll find out soon that you downloaded a ppt with an image that you can't edit.
- logicchains 2y agoThey can spit out LaTeX, and a PDF from that is going to look much nicer than a Google doc (and display the same everywhere). As an added bonus, the recruiter can't randomly rewrite parts of it (at least not so easily).
- Der_Einzige 2y agoRE: Slop: Having Slop generations from an LLM is a choice. There are so many tricks to make models genuinely creative just at the sampler level alone. https://github.com/sam-paech/antislop-sampler https://github.com/sam-paech/antislop-sampler https://openreview.net/forum?id=FBkpCyujtS https://openreview.net/forum?id=FBkpCyujtS
- simonw 2y agoIt doesn't matter how good the generated text is: it is still slop if the recipient didn't request it and no human has reviewed it.
- Der_Einzige 2y agoBy that definition machine to machine communication that happens "organically" (like how humans do it, where they sometimes strike up conversations unprompted with each other) is "slop". You're not seeing how the future of the world will develop.
- orbital-decay 2y agoThis won't solve anything. There's a myriad of sampling strategies, and they all have the same issue: samplers are dumb. They have no access to the semantics of what they're sampling. As a result, things like min-p or XTC will either overshoot or undershoot as they can't differentiate between the situations. For the same reason, samplers like DRY can't solve repetition issues. Slop is over-representation of model's stereotypes and lack of prediction variety in cases that need it. Modern models are insufficiently random when it's required. It's not just specific words or idioms, it's concepts on very different abstraction levels, from words to sentence patterns to entire literary devices. You can't fix issues that appear on the latent level by working with tokens. The antislop link you give seems particularly misguided, trying to solve an NLP task programmatically. Research like [1] suggests algorithms like PPO as one of the possible culprits in the lack of variety, as they can filter out entire token trajectories. Another possible reason is training on outputs from the previous models and insufficient filtering of web scraping results. And of course, prediction variety != creativity, although it's certainly a factor. Creativity is an ill-defined term like many in these discussions. [1] https://arxiv.org/abs/2406.05587 https://arxiv.org/abs/2406.05587
- draw_down 2y agoI agree the criticism is poor; it’s often very lazy. There are currently a lot of dog-brain “wrap a LLM around it” products, which are worthy of scorn. Much of the lazy criticism is pointing at such products and therefore writing off the whole endeavor. But that doesn’t necessarily reflect the potential of the underlying technology, which is developing rapidly. Websites were goofy and pointless until Amazon came around (or Yahoo or whatever you prefer). I guess potential isn’t very exciting or interesting on its own.
- dtquad 2y agoWhat is the current status on pushing "reasoning" down to latent/neural space? Seems like a vaste of tokens to let a model converse with itself especially when this internal monologue often has very little to do with the final output so it's not useful as a log of how the final output was derived.
- antirez 2y agoAbout "people still thinking LLMs are quite useless", I still believe that the problem is that most people are exposed to ChatGPT 4o that at this point for my use case (programming / design partner) is basically a useless toy. And I guess that in tech many folks try LLMs for the same use cases. Try Claude Sonnet 3.5 (not Haiku!) and tell me if, while still flawed, is not helpful. But there is more: a key thing with LLMs is that their ability to help, as a tool, changes vastly based on your communication ability. The prompt is the king to make those models 10x better than they are with the lazy one-liner question. Drop your files in the context window; ask very precise questions explaining the background. They work great to explore what is at the borders of your knowledge. They are also great at doing boring tasks for which you can provide perfect guidance (but that still would take you hours). The best LLMs (in my case just Claude Sonnet 3.5, I must admit) out there are able to accelerate you.
- wslh 2y agoRight, in simpler terms: The measure of LLMs success is how effectively they help you achieve your goal faster.
- antirez 2y agoExactly, and right now the LLMs acceleration effect is a tool, not "give me the final solution". Even people that can't code, using LLMs to build applications from scratch, still have this tool mindset. This is why they can use them effectively: they don't stop at the first failed solution; they provide hints to the LLM, test the code, try to figure what's the problem (also with the LLM help), and so forth. It's a matter of mindset.
- d0mine 2y agobtw, fusion has arrived by that definition: No reactors that would produce more energy than they consume, But net positive reactions have been achieved. Tasks where LLMs output is more than 1x are few and far between.
- andrewaylett 2y ago
- nntwozz 2y agoI think John Gruber summed it up nicely: https://daringfireball.net/2024/12/openai_unimaginable https://daringfireball.net/2024/12/openai_unimaginable OpenAI’s board now stating “We once again need to raise more capital than we’d imagined” less than three months after raising another $6.6 billion at a valuation of $157 billion sounds alarmingly like a Ponzi scheme — an argument akin to “Trust us, we can maintain our lead, and all it will take is a never-ending stream of infinite investment.”
- hdjjhhvvhga 2y agoWhat is funny is that their "lead" is just because of inertia - they were the first to make an LLM publicly available. But they are no longer leaders so their attempts at getting more and more money only prove Altman's skills at convincing people to give him money.
- theferalrobot 2y agoWhich models perform better than 4o or o1 for your use cases? In my limited tests (primarily code) nothing from llama or Gemini have come close, Claude I’m not so sure about.
- torginus 2y agoHow good is the best model of your choice at doing architecture work for complex and nontrivial apps? I have been bashing my head against the wall over the course of the past few days trying to create my (quite complex) dream app. Most of LLM coding I've done involved in writing code to interface with already existing libs or services and the LLMs are great at that. I'm hung up on architecture questions that are unique to my app and definitely not something you can google.
- fullstackchris 2y agoDon't wanna be that typical hackernews guy but I couldnt resist... if your app is "quite complex" there is probably a way or ways you can break it down into much simpler parts. Easier for you AND the LLM. It always comes back to architecture and composition ;)
- deleted 2y ago[deleted]
- sowbug 2y agoSimon has mentioned in multiple articles how cool it is to use 64GB DRAM for GPU tasks on his MacBook. I agree it's cool, but I don't understand why it is remarkable. Is Apple doing something special with DRAM that other hardware manufacturers haven't figured out? Assuming data centers are hoovering up nearly all the world's RAM manufacturing capacity, how is Apple still managing to ship machines with DRAM that performs close enough for Simon's needs to VRAM? Is this just a temporary blip, and PC manufacturers in 2025 will be catching up and shipping mini PCs that have 64GB RAM ceilings with similar memory performance? What gives?
- post-it 2y agoApple designs its own chips, so the RAM and CPU are on the same die and can talk at very high speeds. This is not the case for PCs, where RAM is connected externally.
- mhh__ 2y agoIt's on the same package but the same die?
- com2kid 2y agoApple uses HBM, basically RAM on the same die as the CPU. It has a lot more memory bandwidth than typically PC dram, but still less than many GPUs. (Although the highest end macs have bandwidth that is in the same ballpark as GPUs)
- viccis 2y agoI didn't realize "agent" designs were that ambiguously defined. Every AI engineer I've talked to uses it to mean a design that combines several separate LLM prompts (or even models) to solve problems in multiple stages.
- simonw 2y agoI'll add that one to the list. Surprisingly it doesn't closely match most of the 211 definitions I've collected already! The closest in that collection is "A division of responsibilities between LLMs that results in some sort of flow?" - https://lite.datasette.io/?json=https://gist.github.com/simonw/bdc7b894eedcfd54f0a2422ea8feaa80#/data/raw?_filter_column=tweet&_filter_op=contains&_filter_value=Division&_sort=rowid https://lite.datasette.io/?json=https://gist.github.com/simo...
- carom 2y agoI am surprised as well, as it only takes a few hundred lines of code to implement them. [1] Agents are an abstraction that creates well defined roles for an LLM or LLMs to act within. It's like object oriented programming for prompts. 1. https://github.com/openai/swarm/tree/main https://github.com/openai/swarm/tree/main
- xnx 2y agoThis sounds like ensemble chain of thought.
- datadrivenangel 2y agoIf the investors ask, those same AI engineers will probably allow the answer to be much more ambiguous.
- submeta 2y agoThank you Simon for the excellent work you do! I learned a lot from you and enjoy reading everything you write. Keep up. And happy new year.
- xnx 2y agoDouble checking, I don't think I saw anything about video generation. Not sure if those fall under the "LLM" umbrella. It came very late in the year, but the Google Veo 2 limited testing are astounding. There are at least a half-dozen other services where you can pay to generate video.
- baobabKoodaa 2y agoVideo generation was covered in OP
- xnx 2y agoI've been surprised that ChatGPT has hung on as long as it has. Maybe 2025 is the year Microsoft pushes harder for their brand of LLM.
- switch007 2y agoI've watched juniors take their output as gospel applying absolutely zero thinking and getting confused when I suggest looking at the reference manual instead I've had PMs believe it can replace all writing of tickets and thinking about the feature, creating completely incomprehensible descriptions and acceptance criteria I've had Slack messages and emails from people with zero sincerity and classic LLM style and the bs that entails I've had them totally confidently reply with absolute nonsense about many technical topics I'm grouchy and already over LLMs
- deleted 2y ago[deleted]
- dartos 2y ago> There’s a flipside to this too: a lot of better informed people have sworn off LLMs entirely because they can’t see how anyone could benefit from a tool with so many flaws. The key skill in getting the most out of LLMs is learning to work with tech that is both inherently unreliable and incredibly powerful at the same time. This is a decidedly non-obvious skill to acquire! I wish the author qualified this more. How does one develop that skill? What makes LLMs so powerful on a day to day basis without a large RAG system around it? Personally, I try LLMs every now and then, but haven’t seen any indication of their usefulness for my day to day outside of being a smarter auto complete.
- lumost 2y agoWhen I started my career in 2010, google was a semi-serious skill. All of the little things that we know how to do now such as ignoring certain sites, lingering on others, and iteratively refining our search queries were not universally known at the time. Experienced engineers often relied on encyclopedic knowledge of their environment or by "reading the manual". In my experience, LLM tools are the same, you ask for something basic initially and then iteratively refine the query either via dialog or a new prompt until you get what you are looking for or hit the end of the LLM's capability. Knowing when you've reached the latter is critically important.
- o11c 2y agoThe problems with that skill is that: * Most existing LLM interfaces are very bad at editing history, instead focusing entirely on appending to history. You can sort of ignore this for one-shot, and this can be properly fixed with additional custom tools, but ... * By the time you refine your input enough to patch over all the errors in the LLM's output for your sensible input, you're bigger than the LLM can actually handle (much smaller than the alleged context window), so it starts randomly ignoring significant chunks of what you wrote (unlike context-window problems, the ignored parts can be anywhere in the input).
- simonw 2y agoYeah, a key thing to understand about LLMs is that managing the context is everything. You need to know when to wipe the slate by starting a new chat session and then pasting across a subset of the previous conversation. A lot of my most complex LLM interactions take place across multiple sessions - and in some cases I'll even move the project from Claude 3.5 Sonnet to OpenAI o1 (or vice versa) to help get out of a rut. It's infuriatingly difficult to explain why I decide to do that though!
- deleted 2y ago[deleted]
- alexashka 2y agoI wonder what the author of this post thinks of human generated slop. For example if someone just takes random information about a topic, organizes it in chronological order and adds empty opinions and preferences to it and does that for years on end - what do you call that?
- webmaven 2y agoAn "Editor".
- dash2 2y agoLook, when are these models going to not just talk to me, but do stuff for me? If they're so clever, why can't I tell one to buy chocolates and send them to my wife? Meanwhile, they can allegedly solve frontier maths problems. What's the holdup to models that go online and perform simple tasks?
- icelancer 2y agoThe last mile problem remains undefeated.
- deleted 2y ago[deleted]
- gs17 2y ago> why can't I tell one to buy chocolates and send them to my wife? I'm pretty sure that's been possible for a while. There was an example where Claude's computer use feature ordered pizza for the dev team through DoorDash: https://x.com/alexalbert__/status/1848777260503077146?lang=en https://x.com/alexalbert__/status/1848777260503077146?lang=e... I don't think the released version of the feature can do it, but it should be possible with today's tech.
- munchler 2y agoLLM's are inherently untrustworthy. They're very good at some tasks, but they still need to be checked and/or constrained carefully, which is probably not the best technology on which to base real-world autonomous agents.
- ripped_britches 2y agoSame reason that a powerful graphing calculator can’t teach a math class. “Unhobbling” needs to occur. This means a lot of things but includes modalities, reliability, persistence, alignment, etc.
- th0ma5 2y agoMore dishonest magical thinking. I wish this guy would learn how systems work and stop flooding the field with mystical nonsense unless he really is trying to make people think LLMs are worthless, then I guess he should be honest about it instead of subversive.
- simonw 2y agoWhich bit was dishonest magical thinking? In case you're interested, here's a summarized list (thanks, Claude) of the negative/critical things I said about LLMs and the companies that build them in this post: https://gist.github.com/simonw/73f47184879de4c39469fe38dbf35141 https://gist.github.com/simonw/73f47184879de4c39469fe38dbf35...
- jdlshore 2y agoI read the article and thought it was well done and level-headed. What exactly did you think was mystical or magical thinking?
- orsenthil 2y agoOne of the best written summary of LLMs for the year 2024. We all have silently started to realize Slops, hopefully we can recognize them more easily and prevent them. Test Driven Development (Integration Tests or functional tests specifically) for Prompt Driven Development seems like the way to go. Thank you, Simon.
- legendofbrando 2y ago@simonw you’ve been awesome all year; loved this recap and look forward to more next year
- Havoc 2y agoGreat summary of highlights. Don't agree with all, but I think it's a very sound attempt at a year in review summary >LLM prices crashed This one has me a little spooked. The white knight on this front (DS) has both announced increases and has had staff poached. There is still Gemini free tier which is ofc basically impossible to beat (solid & functionally unlimited/free) but it's google so reluctant to trust. Seriously worried about seeing a regression on pricing in first half of 2025. Especially with the OAI $200 price anchoring. >“Agents” still haven’t really happened yet Think that's largely because it's a poorly defined concept and true "agent" implies some sort of pseudo-agi autonomy. This is a definition/expectation issue rather than technical in my mind >LLMs somehow got even harder to use I don't think that's 100%. An explosion of options is not equal to harder to use. And the guidance for noobs is still pretty much same as always (llama.cp or one of the common frontends like text-generation-webui). It's become harder to tell what is good, but not to get going. ---- One key theme I think is missing is just how hard it has become to tell what is "good" for the average user. There is so much benchmark shenanigans going on that it's just impossible to tell. I'm literally at the "I'm just going to build my own testing framework" stage. Not because I can do better technically (I can't)...but because I can gear it towards things I care about and I can be confident my DIY sample hasn't been gamed.
- simonw 2y agoThe biggest reason I'm not worried about prices going back up again is Llama. The Llama 3 models are really good, and because they are open weight there are a growing number of API providers competing to provide access to them. These companies are incentivized to figure out fast and efficient hosting for the models. They don't need to train any models themselves, their value is added entirely in continuing to drive the price of inference down. Groq and Cerberus are particularly interesting here because WOW they serve Llama fast.
- theanonymousone 2y ago> There is still Gemini free tier which is ofc basically impossible to beat Is it free free? The last time I checked there was a daily request limit, still generous but limiting for some use cases. Isn't it still the case?
- blurbleblurble 2y agoLarge concept models are really exciting
- voidhorse 2y agoGreat write up! Unfortunately, I think this article accurately reflects how we've made little progress on the most important aspects of LLM hype and use: the social ones. A small number of people with lots of power are essentially deciding to go all in on this technology presumably because significant gains will mean the long term reduction of human labor needs, and thus human labor power. As the article mentions, this also comes at huge expenditure and environmental impact, which is already a very important domain in crisis that we've neglected. The whole thing especially becomes laughable when you consider that many people are still using these tools to perform tasks that could be preformed with a margin of more effort using existing deterministic tools. Instead we are now opting for a computationally more expensive solution that has a higher margin of error. I get that making technical progress in this area is interesting, but I really think the lower level workers and researchers exploring the space need to be more emphatic about thinking about socioeconomic impact. Some will argue that this is analogous to any other technological change and markets will adjust to account for new tool use, but I am not so sure about this one. If the technology is really as groundbreaking as everyone wants us to believe then logically we might be facing a situation that isn't as easy to adapt to, and I guarantee those with power will not "give a little back" to the disenfranchised masses out of the goodness of their hearts. This doesn't even raise all the problems these tools create when it comes to establishing coherent viewpoints and truth in ostensibly democratic societies, which is another massive can of worms.
- bwhiting2356 2y agoSome amount of LLM gullibility may be needed. Let's say I have a RAG use case for internal documents about how my business works. I need the LLM to accept what I'm telling it about my business as the truth without questioning it. If I got responses like "this return policy is not correct", LLMs would fail at my use case.
- layer8 2y agoYou don’t need gullibility for that, just the ability to work based on premises (hypotheticals) that you feed it. To the LLM it shouldn’t matter if the hypotheticals are real or not. That’s independent of whether the LLMs judges them as plausible or not. Not being able to semi-accurately judge the plausibility of things would make it gullible.
- calebm 2y agoI love your breadth-first approach of having an outline at the top.
- simonw 2y agoI wrote custom software for that! https://tools.simonwillison.net/render-markdown https://tools.simonwillison.net/render-markdown - If you paste in some Markdown with ## section headings in it the output will start with a <ul> list of links to those headings.
- layer8 2y agoIt’s somehow funny to experience the juxtaposition of the technological progress with LLMs and how decades-old basic functions like TOC creation for a blog post still require custom software. ;)
- rcdwealth 2y ago[dead]
- nektro 2y agoi learned this industry has lower morals and standards for excellence than i ever previously expected
- wpnx 2y agoThank you Simon
- k__ 2y agoI'm glad that so many open source and even "small" models like Gemma are better than gpt4.
- andrethegiant 2y ago> I find the term “agents” extremely frustrating. It lacks a single, clear and widely understood meaning... but the people who use the term never seem to acknowledge that. This 100%. “Agentic” especially as a buzzword can piss off
- cbeach 2y agoThe software "has agency"? That is, I can entrust it to carry out the task I've described, to completion, without telling it how to perform the task?
- simonw 2y agoThat's one of the more common definitions people use - especially people who aren't directly building agents, since the builders tend to get more hung up on "LLM with access to tools" or similar. My problem is when people use that definition (or any other) without clarifying, because they assume it's THE obvious definition.
- tucnak 2y agoWorkflows aside, I think "interruptible work" is what matters, really. That is, maintaining state in-between inferences so that it follows some well-defined goal.
- phillipcarter 2y agoI find that Anthropic has a good, clarifying set of definitions with examples: https://www.anthropic.com/research/building-effective-agents https://www.anthropic.com/research/building-effective-agents
- simonw 2y agoGenuinely the best piece of writing I've seen about agents anywhere.
- deleted 2y ago[deleted]
- lionkor 2y agoThe LLM goalpost keeps moving, apparently. They are not useful for most everyday tasks, e.g. suggesting games, coming up with plans, activities, anything creative that requires knowledge, understanding and creativity. This has always been the benchmark, they are not that useful to me. Everytime I say this, someone hits me with the "yeah, I bet you haven't tried ShitLLM 4.0-pqr". It's very tiring. Your new LLM hype model is nothing but a marginal, over hyped improvement over something that fundamentally is not intelligent.
- JCM9 2y agoNice overview. The challenge ahead for “AI” companies is that it appears there’s really no technical moat here. Someone comes out with something amazing and new and within months (if not weeks or days) it’s quickly copied. That environment where everything quickly becomes a commodity is a recipe for many/most companies in this space to quickly get washed out as it becomes economically unviable to play in such an environment. The money is still flowing, for now, to subsidize that fiasco but as soon as that starts to slow, even just a bit, things are gonna get bumpy real quick. Super excited about this tech but there are dark storm clouds building on the horizon and absent a major “moat” breakthrough it’s gonna get rough soon.
- Legend2440 2y agoThat may be a challenge for AI companies but that doesn't sound like a problem to me. Commodities are great for consumers.
- JCM9 2y agoNot necessarily. The playbook of what tends to happen is first a bunch of players go bust in the race to the bottom, then the survivors are free to raise prices a bit when others realize there’s not much point in entering a race to the bottom. Those left then let quality slip as competition cools. That’s exactly what happened with rideshare companies. It was an amazing new thing but subsidized in an unsustainable way, then a bunch of companies exited the space when it was an commoditized race to the bottom and those left let quality slip. Now when you order an Uber a car shows up that smells bad and has wheels about to fall off. The consumer experience was a lot better when Uber was a VC subsidized bonanza
- nextworddev 2y agoSimon does great work serving as a LLM historian. Have a happy 2025!
- paulo222 2y ago[dead]
- n144q 2y agoAbout "knowledge is incredibly unevenly distributed", an interesting fact is that women is much less likely to use LLMs, if they hear about them/follow updates in the first place: https://www.economist.com/finance-and-economics/2024/08/21/why-dont-women-use-artificial-intelligence https://www.economist.com/finance-and-economics/2024/08/21/w...
- whatshisface 2y agoCan someone please just tell me what model and workflow is so productive? I've seen so many allusions to the concept of skills for LLM use but no explanations of what they are.
- simonw 2y agoThe best LLM for code right now, in my opinion, is still Claude 3.5 Sonnet. The big challenge is figuring out how to use it. I usually like working at the function level: I figure out the exact function signature I want in Python or JavaScript and then get Claude to implement it for me. Claude Artifacts are neat too: Claude can build a full HTML+JavaScript UI, and then iterate on it. I use this for interactive UI prototypes and building small tools. I've published a whole lot of notes on this stuff here: https://simonwillison.net/tags/ai-assisted-programming/ https://simonwillison.net/tags/ai-assisted-programming/
- mike_hearn 2y agoI found it easiest to use Aider with Claude. It's also IDE independent.
- nobodywillobsrv 2y agoOne interesting test that I see nearly all LLMs fail is coherent responses to tax questions.
- foxhop 2y agoStep 1: curate a context window of code from different repos (poke team about switching to mono repo) Step 2: write a slack style message as if you are discussing the solution with a teammate that you have authority over as a delegate to get shit done & to revise as needed. Step 3: press enter, LLM does something you don't like, delete history, fix prompt in step 2 and ask again, rinse and repeat until you have working code. Step 4: ask for the changes to be written as a bash file that cat EOF all the files that change into place, run the script. Step 5: git diff & play test the changes using functional testing (use your mouse & keyboard test the code paths that changed...) Step 6: continue prompting & deleting history as needed to refine. Step 7: commit code to repos
- JimmyWilliams1 2y ago[dead]
- m3kw9 2y agoInterestingly, there isn't much big news about jail breaking or safety alignment
- simonw 2y agoWas there much big news around that in 2024? There were a few interesting papers - the Anthropic one about alignment faking https://www.anthropic.com/news/alignment-faking https://www.anthropic.com/news/alignment-faking and the OpenAI o1 system card https://simonwillison.net/2024/Dec/5/openai-o1-system-card/ https://simonwillison.net/2024/Dec/5/openai-o1-system-card/ - and OpenAI continued to push their "instruction hierarchy" idea, any other big moments? I'll be honest, I don't follow that side of things very closely (outside of complaining that prompt injection still isn't fixed yet).
- surfingdino 2y agoIf I learned anything, it would be that LLMs' non-deterministic nature makes them great are generating output that we can argue over, but they are not a great tool. for doing actual work. I am not asking for much. In my field of work, I use Jetbrains' IDEs, which have now been "enhanced" with AI. I had to turn this feature off, because I kept having to remove code, imports randomly added by the IDE. This was distracting and wasted my time.