12 ms·
My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
- croes 1y agoI bet the training data included enough space invader cloned in JS
- jplrssn 1y agoI also wouldn't be surprised if labs were starting to mix in a few pelican SVGs into their training data.
- quantumHazer 1y agoSVG benchmarking is a thing since GPT-4, so probably all major labs are overfitting on some dataset ov svg images for sure
- diggan 1y agoEven "accidentally" it makes sense that "SVGs of pelicans riding bikes" are now included into datasets used for training as it has spread as a wildfire on the internet, making it less useful as a simple benchmark. This is why I keep all my benchmarks private and don't share anything about them publicly, as soon as you write about them anywhere publicly they'll stop being useful in some months.
- toyg 1y ago> This is why I keep all my benchmarks private This is also why, if I were an artist or anyone commercially relying on creative output of any kind, I wouldn't be posting anything on the internet anymore, ever. The minute you make anything public, the engines will clone it to death and turn it into a commodity.
- __mharrison__ 1y agoSomewhat defeats the purpose of being an artist, doesn't it?
- toyg 1y agoDefeating the purpose of creating almost anything, really. AI is definitely breaking the whole "labor for money" architecture of our world.
- zhengyi13 1y agoEeeehhhh. Maybe the thing to do is provide public, physical exhibits of your art in search of patronage.
- diggan 1y agoWorth noting, in case people weren't aware, but bunch of people have different motivations for being artists, not everyone wants everything they do to be as widely shared as possible, some are happy playing/drawing/whatever for a small group of people, and not even making money off it.
- debugnik 1y agoThat makes it so much harder to show art to people and market yourself though. I considered experimenting with web DRM for art sites/portfolios, on the assumption that scrappers won't bother with the analog loophole (and dedicated art-style cloners would hopefully be disappointed by the quality), but gave up because of limited compatible devices for the strongest DRM levels, and HDCP being broken on those levels anyway. If the DRM technique caught on it would take attackers, at most, a few bucks and hours once to bypass it, and I don't think users would truly understand that upfront.
- simonw 1y agoI'll believe they are doing that when one of the models draws me an SVG that actually looks like a pelican.
- __mharrison__ 1y agoSomeone needs to craft a beautifully bike donned by a pelican, throw in some seo, and see how long it takes a model to replicate it. Simon probably wouldn't be happy about killing his multi-year evaluation metric though...
- simonw 1y agoI would be delighted. My pelican on a bicycle benchmark is a long con. The goal is to finally get a good SVG of a pelican riding a bicycle, and if I can trick AI labs into investing significant effort in cheating on my benchmark then fine, that gets me my pelican!
- gchamonlive 1y agoWhich would make this disappointing if it was only good at cloning space invaders. If it can reproduce all the clone it has ever seen it would still be an impressive feat. I just think we should stop to appreciate exactly how awesome language models are. It's compressing and correctly reproducing a lot of data with meaningful context between each token and the rest of the context window. It's still amazing, specially with smaller models like this, because even if it's reproducing a clone, you can still ask questions about it and it should perform reasonably well explaining you what it does and how you can take it over to further develop that clone.
- croes 1y agoBut that would still be copy and paste with extra steps. Like all these vibe coded to do apps, one of the most used starting problems of programming courses. It’s great that an AI can do that but it could stall progress if we get limited to existing tools and programs.
- shermantanktop 1y agoHow about an SVG of 9.11 pelicans riding bicycles and counting the three Rs in “strawberry”?
- chickenzzzzu 1y ago"2.5 year old laptop" is potentially the most useless way of describing a 64GB M2, as it could be confused with virtually any other configuration of laptop.
- OJFord 1y agoI think the point is just that it doesn't require absolute cutting edge nor server hardware.
- jphoward 1y agoNo but 64 GB of unified memory provides almost as much GPU RAM capacity as two RTX 5090s (only less due to the unified nature) - top of the range GPUs - so it's a truly exceptional laptop in this regard.
- turnsout 1y agoExcept that it is not exceptional at all; it's an older-generation MacBook Pro with 64GB of RAM. There's nothing particularly unusual about it.
- jphoward 1y ago64 GB of RAM which is addressable by a GPU is exceptional for a laptop - this is not just system RAM.
- chickenzzzzu 1y agoTo emphasize this point further, at least with my efforts, it is not even possible to buy a 64GB M4 Pro right now. 32GB, 64GB, and 128GB are all sold out. We can say that 64GB addressable by a GPU is not exceptional when compared to 128GB and it still costs less than a month's pay for a FAANG engineer, but the fact that they aren't actually purchasable right now shows that it's not as easy as driving to Best Buy and grabbing one off the shelf.
- AlexeyBrin 1y agoMost likely its training data included countless Space Invaders in various programming languages.
- quantumHazer 1y agoand probably some synthetic data are generated copy of the games already on the dataset? i have this feeling with LLM's generated react frontend, they all look the same
- bayindirh 1y agoLast time somebody asked for a "premium camera app for iOS", and the model (re)generated Halide. Models don't emit something they don't know. They remix and rewrite what they know. There's no invention, just recall...
- FeepingCreature 1y agoTrue where trivial; where nontrivial, false. Trivially, humans don't emit something they don't know either. You don't spontaneously figure out Javascript from first principles, you put together your existing knowledge into new shapes. Nontrivially, LLMs can absolutely produce code for entirely new requirements. I've seen them do it many times. Will it be put together from smaller fragments? Yes, this is called "experience" or if the fragments are small enough, "understanding".
- bayindirh 1y agoHumans can observe ants and invent any colony optimization. AIs can’t. Humans can explore what they don’t know. AIs can’t.
- falcor84 1y agoWhat makes you categorically say that "AIs can't"? Based on my experience with present day AIs, I personally wouldn't be surprised at all that if you showed Gemini 2.5 Pro a video of an insect colony and asked it "Take a look at the way they organize and see if that gives you inspiration for an optimization algorithm", it will spit something interesting out.
- NitpickLawyer 1y ago> Two years ago when I first tried LLaMA I never dreamed that the same laptop I was using then would one day be able to run models with capabilities as strong as what I’m seeing from GLM 4.5 Air—and Mistral 3.2 Small, and Gemma 3, and Qwen 3, and a host of other high quality models that have emerged over the past six months. Yes, the open-models have surpassed my expectations in both quality and speed of release. For a bit of context, when chatgpt launched in Dec22, the "best" open models were GPT-J(~6-7B) and GPT-neoX (~22B?). I actually had an app running live, with users, using gpt-j for ~1 month. It was a pain. The quality was abysmal, there was no instruction following (you had to start your prompt like a story, or come up with a bunch of examples and hope the model will follow along) and so on. And then something happened, LLama models got "leaked" (I still think it was a on purpose leak - don't sue us, we never meant to release, etc), and the rest is history. With L1 we got lots of optimisations like quantised models, fine-tuning and so on, L2 really saw fine-tuning go off (most of the fine-tunes were better than what meta released), we got alpaca showing off LoRA, and then a bunch of really strong models came out (mistrals, mixtrals, L3, gemmas, qwens, deepseeks, glms, granites, etc.) By some estimations the open models are ~6mo behind what SotA labs have released. (note that doesn't mean the labs are releasing their best models, it's likely they keep those in house to use on next runs data curation, synthetic datasets, for distilling, etc). Being 6mo behind is NUTS! I never in my wildest dreams believed we'll be here. In fact I thought it would take ~2years to reach gpt3.5 levels. It's really something insane that we get to play with these models "locally", fine-tune them and so on.
- tonyhart7 1y agois GLM 4.5 better than Qwen3 coder??
- diggan 1y agoFor what? It's really hard to say what model is "generally" better then another, as they're all better/worse at specific things. My own benchmarks has a bunch of different tasks I use various local models for, and I run it when I wanna see if a new model is better than the existing ones I use. The output is basically a markdown table with a description of which model is best for what task. They're being sold as general purpose things that are better/worse at everything but reality doesn't reflect this, they all have very specific tasks they're worse/better at, and the only way to find that out is by having a private benchmark you run yourself.
- pulkitsh1234 1y agoIs there any website to see the minimum/recommended hardware required for running local LLMs? Much like 'system requirements' mentioned for games.
- GaggiX 1y agohttps://apxml.com/tools/vram-calculator https://apxml.com/tools/vram-calculator This one is very good in my opinion.
- jxf 1y agoDon't think it has the GLM series on there yet.
- knowaveragejoe 1y agoIf you have a HuggingFace account, you can specify the hardware you have and it will show on any given model's page what you can run.
- CharlesW 1y ago> Is there any website to see the minimum/recommended hardware required for running local LLMs? LM Studio (not exclusively, I'm sure) makes it a no-brainer to pick models that'll work on your hardware.
- qingcharles 1y agoThis can be a useful resource too: https://www.reddit.com/r/LocalLLaMA/ https://www.reddit.com/r/LocalLLaMA/
- svachalek 1y agoIn addition to the tools other people responded with, a good rule of thumb is that most local models work best* at q4 quants, meaning the memory for the model is a little over half the number of parameters, e.g. a 14b model may be 8gb. Add some more for context and maybe you want 10gb VRAM for a 14gb model. That will at least put you in the right ballpark for what models to consider for your hardware. (*best performance/size ratio, generally if the model easily fits at q4 you're better off going to a higher parameter count than going for a larger quant, and vice versa)
- bradly 1y agoI appreciate you sharing both the chat log and the full source code. I would be interested to see a followup post on how adding moderately-sized features like High Score go. Also, IANAL but Space Invaders is owned IP. I have no idea the legality of a blog post describing steps to create and releasing an existing game, but I've seen headlines on HN of engs in trouble for things I would not expect to be problematic. Maybe Space Invaders is in q-tip/band-aid territory at this point?, but if this was Zelda instead of Space Invaders, I could see things being more dicey.
- Joker_vD 1y ago> Space Invaders is owned IP So is Tetris. And I believe that Snake is also an owned IP although I could be wrong on this one.
- sowbug 1y agoIt doesn't infringe any kind of intellectual property. This isn't copyright infringement; it isn't based on the original assembly code or artwork. A game concept can't be copyrighted. Even if one of SI's game mechanics were patented, it would have long expired. Trade secret doesn't apply in this situation. That leaves trademark. No reasonable person would be confused whether Simon is trying to pass this creation off as a genuine Space Invaders product.
- 9rx 1y ago> No reasonable person would be confused whether Simon is trying to pass this creation off as a genuine Space Invaders product. There may be no reasonable confusion, but trademark holders also have to protect against dilution of their brand, if they want to retain their trademark. With use like this, people might come to think of Space Invaders as a generic term for all games of this type, not the brand of a specific game. (there is a strong case to be made that they already do, granted)
- pamelafox 1y agoAlas, my 3 year old Mac has only 16 GB RAM, and can barely run a browser without running out of memory. It's a work-issued Mac, and we only get upgrades every 4/5 years. I must be content with 8B parameters models from Ollama (some of which are quite good, like llama3.1:8b).
- e1gen-v 1y agoJust download more ram!
- GaggiX 1y agoReasoning models like qwen3 are even better, and they have more options, for example you can choose the 14B model (at the usual 4KM quantization) instead of the 8B model.
- dreamer7 1y agoI am able to run Gemma 3 12B on my M1 MBP 16GB. It is pretty good at logic and reasoning!
- __mharrison__ 1y agoOdd. My MBP has 16 GB and I routinely have 5 browsers windows open. Most of them have 5-20 tabs. I'm also routinely running vi vscode and editing videos with davinci resolve without issue. My only memory issue that I can remember is an OBS memory leak, otherwise these MBPs incredible hardware. I wish any other company could actually deliver a comparable machine.
- neutronicus 1y agoIf I understand correctly, the author is managing to run this model on a laptop with 64GB of RAM? So a home workstation with 64GB+ of RAM could get similar results?
- lynndotpy 1y agoThe laptop has "unified RAM", so that's like 64GB of VRAM.
- simonw 1y agoOnly if that RAM is available to a GPU, or you're willing to tolerate extremely slow responses. The neat thing about Apple Silicon is the system RAM is available to the GPU. On most other systems you would need ~48GB of VRAM.
- xrd 1y agoAren't there non-Macos laptops which also support sharing the VRAM and regular RAM, i.e. iGPU? https://www.reddit.com/r/GamingLaptops/comments/1akj5aw/whats_the_best_igpu_laptop/ https://www.reddit.com/r/GamingLaptops/comments/1akj5aw/what... I personally want to run linux and feel like I'll get a better price/GB offering that way. But, it is confusing to know how local models will actually work on those and the drawbacks of iGPU.
- mft_ 1y agoiGPUs are typically weak, and/or aren't capable of running the LLM so the CPU is used instead. You can run things this way, but it's not fast, and it gets slower as the models go up in size. If you want things to run quickly, then aside from Macs, there's the 2025 ASUS Flow z13 which (afaik) is the only laptop with AMD's new Ryzen Max+ 395 processor. This is powerful and has up to 128Gb of RAM that can be shared with the GPU, but they're very rare (and Mac-expensive) at the moment. The other variable for running LLMs quickly is memory bandwidth; the Max+ 395 has 256Gb/s, which is similar to the M4 Pro; the M4 Max chips are considerably higher. Apple fell on their feet on this one.
- 1y ago
- larodi 1y agoIs probably more correct to say - my 2.5 year laptop can RETELL space invaders. Pretty sure it cannot write a game it has never seen, so you can even say - my old laptop can now do this fancy extraction of data from a smart probabilistic blob, where the original things are retold in new colours and forms :)
- simonw 1y agoI know these models can build games and apps they've never seen before because I've already observed them doing exactly that time and time again. If you haven't seen that yourself yet I suggest firing up the free, no registration required GLM-4.5 Air on https://chat.z.ai/ https://chat.z.ai/ and seeing if you can prove yourself wrong.
- th0ma5 1y ago[flagged]
- dang 1y agoPlease see https://news.ycombinator.com/item?id=44726957 https://news.ycombinator.com/item?id=44726957 and please stop posting these.
- larodi 1y agoI’m using all major models it a daily driver and none of these can create anything I have not spent excessive amount of time explaining. It works for me on the architectural level, but does not change the fact that your expounding on prior information and not a new one. Not sure though why I’m getting downvoted.
- simonw 1y agoYou said: "Pretty sure it cannot write a game it has never seen" Then you said: "none of these can create anything I have not spent excessive amount of time explaining" Presumably then they CAN create a game they have never seen if you spend an "excessive amount of time" explaining that game? So are you talking about game design here? It can implement anything, but it can't design entirely new games without human input?
- anthk 1y agoWritting a Z80 emulator with the original Space Invaders ROM will make you more fullfilled. Either with SDL2+C, or even TCL/Tk, or Pythn with TKInter.
- vFunct 1y agoplease please apple give us a M5 MacBook Pro laptop with 2TB of unified memory please please
- stpedgwdgfhgdd 1y agoAside that space invaders from scratch is not representative for real engineering, it will be interesting to see what the business model for Anthropic will be if I can run a solid code generation model on my local machine (no usage tier per hour or week), let’s say, one year from now. At $200 per month for 2 years I can buy a decent Mx with 64GB (or perhaps even 128GB taking residual value into account)
- falcor84 1y agoHow come it's "not representative for real engineering"? Other than copy-pasting existing code (which is not what an LLM does), I don't see how you can create a space invaders game without applying "engineering".
- phkahler 1y ago>> Other than copy-pasting existing code (which is not what an LLM does) I'd like to see someone try to prove this. How many space invaders projects exist on the internet? I'd be hard to compare model "generated" code to everything out there looking for plagiarism, but I bet there are lots of snippets pulled in. These things are NOT smart, they are huge and articulate information repositories.
- simonw 1y agoGo for it. https://www.google.com/search?client=firefox-b-1-d&q=github+space+invaders https://www.google.com/search?client=firefox-b-1-d&q=github+... has a bunch of results. Here's the source code GLM-4.5 Air spat out for me on my laptop: https://github.com/simonw/tools/blob/main/space-invaders-GLM-4.5-Air-3bit.html https://github.com/simonw/tools/blob/main/space-invaders-GLM... Based on my mental model of how these things work I'll be genuinely surprised if you can find even a few lines of code duplicated from one of those projects into the code that GLM-4.5 wrote for me.
- phkahler 1y agoSo I scanned the beginning of the generated code, picked line 83: animation: glow 2s ease-in-out infinite; stuffed it verbatim into google and found a stack overflow discussion that contained this: animation: glow .5s infinite alternate; in under one minute. Then I found this page of CSS effects: https://alvarotrigo.com/blog/animated-backgrounds-css/ https://alvarotrigo.com/blog/animated-backgrounds-css/ Another page has examples and contains: animation: float 15s infinite ease-in-out; There is just too much internet to scan for an exact match or a match of larger size.
- deleted 1y ago[deleted]
- karenbass 1y ago[dead]
- amelius 1y agoWake me up when I can apt-get install the llm.
- Kurtz79 1y agoYou can install ollama with a script fetched with curl and run a llm model with a grand total of two bash commands (including curl).
- jus3sixty 1y agoI recently let go of my 2.5 year old vacuum. It was just collecting dust.
- falcor84 1y agoThinking about it, the measure of whether a vacuum is being sufficiently used is probably that the circulation of dust within it over the last year is greater than the circulation of dust on its external boundary over that time period.
- alankarmisra 1y agoI see the value in showcasing that LLMs can run locally on laptops — it’s an important milestone, especially given how difficult that was before smaller models became viable. That said, for something like this, I’d probably get more out of simply finding an existing implementation on github or the like and downloading that. When it comes to specialized and narrow domains like Space Invaders, the training set is likely to be extremely small and the model's vector space will have limited room to generalize. You'll get code that is more or less identical to the original source and you also have to wait for it to 'type' the code and the value add seems very low. I would rather ask it to point me to known Space Invaders implementations in language X on github (or search there). Note that ChatGPT gets very nervous if I put this into GPT to clean up the grammar. It wants very badly for me to stress that LLMs don't memorize and overfitting is very unlikely (I believe neither).
- tossandthrow 1y agoInteresting, I can not produce these warnings in ChatGPT - though this is something that really interests me, as it represents immense political power to be able ti interject such warnings (explicitly, or implicitly by slight reformulations)
- deleted 1y ago[deleted]
- aaron695 1y ago[dead]
- dr-detroit 1y ago[dead]
- deleted 1y ago[deleted]
- efitz 1y agoI missed the word “laptop” in the title at first glance and thought this was a “I taught my toddler to code” article.
- juliangoetze 1y agoI thought I was the only one.
- below43 1y agoSame here. Pretty impressive LLM.
- joelthelion 1y agoApart from using a Mac, what can you use for inference with reasonable performance? Is a Mac the only realistic option at the moment?
- whimsicalism 1y agoyou are almost certainly better off renting GPUs, but i understand self-hosting is an HN touchstone
- qingcharles 1y agoThis. Especially if you just want to try a bunch of different things out. Renting is insanely cheap -- to the point where I don't understand how the renters are making their money back unless they stole the hardware and power. It can really help you figure a ton of things out before you blow the cash on your own hardware.
- 4b11b4 1y agoRecommended sites to rent from
- doormatt 1y agorunpod.io
- whimsicalism 1y agorunpod, vast, hyperbolic, prime intellect. if all you're doing is going to be running LLMs, you can pay per token on openrouter or some of the providers listed there
- mrinterweb 1y agoI don't know about that. I've had my RTX 4090 for nearly 3 years now. If I had a script that provisioned and deprovisioned a rented 4090 at $0.70/hr for an 8 hour work day for 20 work days per month. Assuming I get 2 paid weeks off per year + normal holidays over 3 years. 0.7 * 8 * ((20 * 12) - 8 - 14) * 3 = $3662 I bought my RTX 4090 for about $2200. I also had the pleasure of being able to use it for gaming when I wasn't working. To be fair, the VRAM requirements for local models keeps climbing and my 4090 isn't able to run many of the latest LLMs. Also, I omitted cost of electricity for my local LLM server cost. I have not been measuring total watts consumed by just that machine. One nice thing about renting is that it give you flexibility in terms of what you want to try. If you're really looking for the best deals look at 3rd party hosts serving open models for the API-based pricing, or honestly a Claude subscription can easily be worth it if you use LLMs a fair bit.
- joshstrange 1y agoMy next MBP is going to need the next size up SSD (RIP bank account) so it can hold all the models I want to play with locally and my data. Thankfully I already have been maxing out the RAM so that isn't something new I also have to do.
- __mharrison__ 1y agoTime to get a new laptop. My MBP only has 16 gigs. Looking forward to trying this with Aider.
- sneak 1y agoWhat is the SOTA for benchmarking all of the models you can run on your local machine vs a test suite? Surely this must exist, no? I want to generate a local leaderboard and perhaps write new test cases.
- deleted 1y ago[deleted]
- petercooper 1y agoI ran the same experiment on the full size model. It used a custom 80s style font (from Google Fonts) and gave 'eyes' and more differences to the enemies but otherwise had a similar vibe to Simon's. An interesting visual demonstration of what quantization does though! Screenshot: https://peterc.org/img/aliens.png https://peterc.org/img/aliens.png
- Strawberry76 1y ago[dead]
- deadbabe 1y agoYou can overtrain a neural network to write a space invaders clone. The final weights might take up less disk space than the output code.
- another_one_112 1y agoCrazy to think that you can have a mostly-competent oracle even when disconnected from the grid.
- dfedbeef 1y agoFinally I can get a maybe correct answer about what to do about my snake bite from my laptop
- indigodaddy 1y agoDid pretty well with a boggle clone. I like that it tries to do a single html file (I didn't ask for that but was pleasantly surprised). It didn't include dictionary validation so needed a couple of prompts. Touch selection on mobile isn't the greatest but I've seen plenty worse https://chat.z.ai/space/z0gcn6qtu8s1-art https://chat.z.ai/space/z0gcn6qtu8s1-art https://chat.z.ai/s/74fe4ddc-f528-4d21-9405-0a8b15a96520 https://chat.z.ai/s/74fe4ddc-f528-4d21-9405-0a8b15a96520
- JKCalhoun 1y agoCool — if only diagonals were easier. ;-) (Hopefully I'm being constructive here.)
- indigodaddy 1y agoYep I tried to have it improve that but actually didn't use the word 'diagonal' in the prompt. I bet it would have done better if I had..
- indigodaddy 1y agoHad it try to improve Diagonal selection but didn't seem to help much https://chat.z.ai/space/b01dc65rg2p0-art https://chat.z.ai/space/b01dc65rg2p0-art
- Keyframe 1y agoI went the other route with tetris clone the other day. It's definitely not a single prompt. It took me solid 15 hours until this stage to get here and most of that me thinking.. BUT, except one small trivial thing (space invader logo in pre tag) I haven't touched code - just looked at it. I made it mandatory for myself to see if I can first greenfield myself into this project and then brownfield features and fixes.. It's definitely a ton of work on my end, but it's also not something I'd be able to do in ~2 working days or less. As a cherry on top, even though it's still not done yet, I put in AI-generated music singing about the project itself. https://www.susmel.com/stacky/ https://www.susmel.com/stacky/ Definitely a ton of things I learned about how to "develop" "with" AI along the way.
- lifestyleguru 1y ago> my 2.5 year old laptop (a 64GB MacBook Pro M2) i My MacBook has 16GB of RAM and it is from a period when everyone was fiercely insisting that 8GB base model is all I'll ever need.
- tracker1 1y agoI'm kind of with you... while I've run 128gb on my desktop, and currently at 96gb with dr5 what it is, It's far less common for typical laptops. I'm a bit curious how the Ryzen 395+ with 128gb will handle some of these models. The 200gb options feel completely out of reach.
- Aurornis 1y agoThis is very cool. The blog had to run it from the main branch of the mlx-lm library and a custom script. Can someone up to date on the local LLM tools let us know which mainstream tools we should be watching for an easier way to run this on MLX? The space moves so fast that it's hard to keep up.
- simonw 1y agoI expect LM Studio will have this pretty soon - I imagine they are waiting on the next stable release of mlx-lm which will include the change I needed to get this to work.
- righthand 1y agoDid you understand the implementation or just that it produced a result? I would hope an LLM could spit out a cobbled form of answer to a common interview question. Today a colleague presented data changes and used an LLM to build a display app for the JSON for presentation. Why did they not just pipe the JSON into our already working app that displays this data? People around me for the most part are using LLMs to enhance their presentations, not to actually implement anything useful. I have been watching my coworkers use it that way for months. Another example? A different coworker wanted to build a document macro to perform bulk updates on courseware content. Swapping old words for new words. To build the macro they first wrote a rubrick to prompt an LLM correctly inside of a word doc. That filled rubrik is then used to generate a program template for the macro. To define the requirements for the macro the coworker then used a slideshow slide to list bullet points of functionality, in this case to Find+Replace words in courseware slides/documents using a list of words from another text document. Due to the complexity of the system, I can’t believe my colleague saved any time. The presentation was interesting though and that is what they got compliments on. However the solutions are absolutely useless for anyone else but the implementer.
- simonw 1y agoI scanned the code and understood what it was doing, but I didn't spend much time on it once I'd seen that it worked. If I'm writing code for production systems using LLMs I still review every single line - my personal rule is I need to be able to explain how it works to someone else before I'm willing to commit it. I wrote a whole lot more about my approach to using LLMs to help write "real" code here: https://simonwillison.net/2025/Mar/11/using-llms-for-code/ https://simonwillison.net/2025/Mar/11/using-llms-for-code/
- th0ma5 1y ago[flagged]
- CamperBob2 1y agoI missed the part where he said he was going to put the Space Invaders game into production. Link?
- aplzr 1y agoI really like talking to Claude (free tier) instead of using a search engine when I'm stumbling upon a random topic that interests me. For example, this morning I had it explain the differences between pass by value, pass by reference, and pass by sharing, the last of which I wasn't aware of until then. Is this kind of thing also possible with one of these self-hosted models in a comparable way, or are they mostly good for coding?
- dcchambers 1y agoAmazing. There really is no secret sauce that the frontier models have.
- accrual 1y agoVery impressive model! The SVG pelican designed by GLM 4.5 in Simon's adjacent article is the most accurate I've seen yet.
- 4b11b4 1y agoQuick, someone knit a quilt with all the different SVG pelicans
- bgwalter 1y agoThe GML-4.5 model utterly fails at creating ASCII art or factorizing numbers. It can "write" Space Invaders because there are literally thousands of open source projects out there. This is another example of LLMs being dumb copiers that do understand human prompts. But there is one positive side to this: If this photocopying business can be run locally, the stocks of OpenAI etc. should got to zero.
- simonw 1y agoWhy would you use an LLM to factorize numbers?
- bgwalter 1y agoBecause we are told that they can solve IMO problems. Yet they fail at basic math problems, not only at factorization but also when probing them with relatively basic symbolic math that would not require the invocation of an external program. Also, you know it they fail they could say so instead of giving a hallucinated answer. First the models lie and say that a 20 digit number takes vast amounts of computing. Then, if pointed to a factorization program they pretend to execute it and lie about the output. There is no intelligence or flexibility apart from stealing other people's open source code.
- simonw 1y agoThat's why the IMO results were so notable: that was one of those moments where new models were demonstrated doing something that they had previously been unable to do.
- ducktective 1y agoI can't fathom why more people aren't talking about the IMO story. Apparently the model they used is not just an LLM but some RL are involved too. If a model wins gold at IMO, is it still merely a "statistical parrot"?
- lherron 1y agoWith the Anthropic rug pull on quotas for Max, I feel the short-mid term value sweet spot will be a Frankensteined together “Claude as orchestrator/coder, falling back to local models as quota limits approach” tool suite.
- 4b11b4 1y agoWas thinking this one might backfire on Anthropic in the end... People are going to explore and get comfortable with alternatives. There may have been other ways to deal with the cases they were worried about.
- h-bradio 1y agoThanks so much for this! I updated LM Studio, and it picked up the mlx-lm update required. After a small tweak to tool-calling in the prompt, it works great with Zed!
- torarnv 1y agoCould you describe the tweak you did, and possibly the general setup you have with zed working with LM Studio? Do you use a custom system prompt? What context size do you use? Temperature? Thanks!
- h-bradio 1y agoHere is how my prompt ended up! https://gist.github.com/hbradio/2f504c3fdb6f7113181b2d8c68622102 https://gist.github.com/hbradio/2f504c3fdb6f7113181b2d8c6862... I just asked an LLM to make it similar to a working Qwen prompt. To make the LLMs able to use tools, I had to configure them in the Zed settings like this: https://gist.github.com/hbradio/fa4b456658a8d250e6ccc69ae9b35e6c https://gist.github.com/hbradio/fa4b456658a8d250e6ccc69ae9b3... Also, I had to go into LM Studio and increase the max context size for each model I wanted to use in Zed. Otherwise it gives a parsing error on the response. I set it to the max allowable value. I start LM Studio, start the LM Studio server, then go to Zeds AI config and tell it to connect to LM Studio. I put it in Agent mode, and it seems to work! I don't know much about temperature, and I didn't use any other system prompt. Good luck!
- ddtaylor 1y agoMy brain is running legacy COBOL and first read this as > My 2.5 year old with their laptop can write Space Invaders For a few hundred milliseconds there I was thinking "these damn kids are getting good with tablets"
- Imustaskforhelp 1y agoDon't worry I guess my brain is running bleeding edge typescript with react (I am in high school for context) and the first time I also read it this way... But I am without my glasses, but still I have hackernews at 250%, I think I am a little cooked lol.
- OldfieldFund 1y agoWe are all cooked at this point :)
- skeezyboy 1y agoBut arent we still decades away from running our own video-creating AIs locally? Have we plateaued with this current generation of techniques?
- polynomial 1y agoAt first I read this as "My 2.5 year old can write Space Invaders in JavaScript now"
- th0ma5 1y ago[flagged]
- simonw 1y agoWhich bit of this post did you find condescending or infantilizing?
- maksimur 1y agoA $xxxx 2.5 year old laptop, one that's probably much more powerful than an average laptop bought today and probably next year as well. I don't think it's a fair reference point.
- parsimo2010 1y agoThe article is pretty good overall, but the title did irk me a little. I assumed when reading "2.5 year old" that it was fairly low-spec only to find out it was an M2 Macbook Pro with 64 GB of unified memory, so it can run models bigger than what an Nvidia 5090 can handle. I suppose that it could be intended to be read as "my laptop is only 2.5 years old, and therefore fairly modern/powerful" but I doubt that was the intention.
- simonw 1y agoThe reason I emphasize the laptop's age is that it is the same laptop I have been using ever since the first LLaMA release. This makes it a great way to illustrate how much better the models have got without requiring new hardware to unlock those improved abilities.
- bprew 1y agoHis point isn't that you can run a model on an average laptop, but that the same laptop can still run frontier models. It speaks to the advancements in models that aren't just throwing more compute/ram at it. Also, his laptop isn't that fancy. > It claims to be small enough to run on consumer hardware. I just ran the 7B and 13B models on my 64GB M2 MacBook Pro! From: https://simonwillison.net/2023/Mar/11/llama/ https://simonwillison.net/2023/Mar/11/llama/
- deleted 1y ago[deleted]
- nh43215rgb 1y agoAbout $3700 laptop...
- asadm 1y agoHow good is this model with tool calling.
- bob1029 1y ago> still think it’s noteworthy that a model running on my 2.5 year old laptop (a 64GB MacBook Pro M2) is able to produce code like this—especially code that worked first time with no further edits needed. I believe we are vastly underestimating what our existing hardware is capable of in this space. I worry that narratives like the bitter lesson and the efficient compute frontier are pushing a lot of brilliant minds away from investigating revolutionary approaches. It is obvious that the current models are deeply inefficient when you consider how much you can decimate the precision of the weights post-training and still have pelicans on bicycles, etc.
- jonas21 1y agoWasn't the bitter lesson about training on large amounts of data? The model that he's using was still trained on a massive corpus (22T tokens).
- yahoozoo 1y agoWhat does that have to do with quantizing?
- itsalotoffun 1y agoI think GP means that if you internalize the bitter lesson (more data more compute wins), you stop imagining how to squeeze SOTA minus 1 performance out of constrained compute environments.
- reactordev 1y agoThis. When we ran out of speed on the CPU, we moved to the GPU. Same thing here. The more we work with (22T) models, quants, and decimating precision - the more we learn and find more novel ways to do things.
- Breza 1y agoVery well put. There's a lot to be gained from using smaller models and existing hardware. So many enterprise PMs skip straight to using a cutting edge LLM via API. There are many tasks where a self-hosted LLM or even a finetuned small language model can either complete a preliminary step or even handle the full task for much less money. And if a self-hosted model can do the job today, imagine what you'll be able to do in a year or five when you have more powerful hardware and even better models.
- lxgr 1y agoThis raises an interesting question I’ve seen occasionally addressed in science fiction before: Could today’s consumer hardware run a future superintelligence (or, as a weaker hypothesis, at least contain some lower-level agent that can bootstrap something on other hardware via networking or hyperpersuasion) if the binary dropped out of a wormhole?
- switchbak 1y agoThis is what I find fascinating. What hidden capabilities exist, and how far could it be exploited? Especially on exotic or novel hardware. I think much of our progress is limited by the capacity of the human brain, and we mostly proceed via abstraction which allows people to focus on narrow slices. That abstraction has a cost, sometimes a high one, and it’s interesting to think about what the full potential could be without those limitations.
- lxgr 1y agoAbstraction, or efficient modeling of a given system, is probably a feature, not a bug, given the strong similarity between intelligence and compression and all that. A concise description of the right abstractions for our universe is probably not too far removed from the weights of a superintelligence, modulo a few transformations :)
- bob1029 1y agoThis is the premise of all of the ML research I've been into. The only difference is to replace the wormhole with linear genetic programming, neuroevolution, et. al. The size of programs in the demoscene is what originally sent me down this path. The biggest question I keep asking myself - What is the Kolmogorov complexity of a binary image that provides the exact same capabilities as the current generation LLMs? What are the chances this could run on the machine under my desk right now? I know how many AAA frames per second my machine is capable of rendering. I refuse to believe the gap between running CS2 at 400fps and getting ~100b/s of UTF8 text out of a NLP black box is this big.
- 1y ago
- wslh 1y agoHere's a sci-fi twist: suppose Space Invaders and similar early games were seeded by a future intelligence. (•_•)⌐■-■
- msikora 1y agoWith 48GB MAcBook Pro M3 I'm probably out of luck, right?
- simonw 1y agoFor this particular model, yes. This new one from Qwen should fit though - it looks like that only needs ~30GB of RAM: https://huggingface.co/lmstudio-community/Qwen3-30B-A3B-Instruct-2507-MLX-8bit https://huggingface.co/lmstudio-community/Qwen3-30B-A3B-Inst...
- omneity 1y agoIt takes ~17-20GB on Q4 depending on context length & settings (running it as we speak) ~30GB in Q8 sure, but it's a minimal gain for double the VRAM usage.
- andai 1y agoI got almost the same result with a 4B model (Qwen3-4B), about 20x smaller than OP's ~200B model. https://jsbin.com/lejunenezu/edit?html,output https://jsbin.com/lejunenezu/edit?html,output Its pelican was a total fail though.
- andai 1y agoUpdate: It failed to make Flappy Bird though (several attempts). This surprises me, I thought it would be simpler than Space Invaders.
- simonw 1y agoThere's a new model from Qwen today - Qwen3-30B-A3B-Instruct-2507 - that also runs comfortably on my Mac (using about 30GB of RAM with an 8bit quantization). I tried the "Write an HTML and JavaScript page implementing space invaders" prompt against it and didn't quite get a working game with a single shot, but it was still an interesting result: https://simonwillison.net/2025/Jul/29/qwen3-30b-a3b-instruct-2507/ https://simonwillison.net/2025/Jul/29/qwen3-30b-a3b-instruct...
- pyman 1y agoI was talking about the new open models with a group of people yesterday, and saying how good they're getting. The big question is: Can any company now compete with the big players? Or even more interesting, like you showed in your research, are proprietary models becoming less relevant now that anyone can run these models locally? This trend of better open models that run locally is really picking up. Do you think we'll get to a point where we won't need to buy AI tokens anymore?
- simonw 1y agoThe problem is cost. A machine that can run a decent local model costs thousands of dollars to buy and won't produce results as good as a model that runs on $30,000+ dedicated servers. Meanwhile you can rent access to LLMs running on those expensive machines for fractions of a cent (because you are sharing them with thousands of other users). I don't think cost will be a reason to use local models for a very long time, if ever.
- xianshou 1y agoI initially read the title as "My 2.5 year old can write Space Invaders in JavaScript now (GLM-4.5 Air)." Though I suppose, given a few years, that may also be true!
- DonHopkins 1y agoGiven a few years your 2.5 year old will be a 5.5 year old, too!
- Breza 1y agoUgh don't remind me. My daughter's fifth birthday is tomorrow and with how fast she's growing I feel like her 15th is on Thursday.
- dust42 1y agoI tried with Claude Sonnet 4 and it does *not* work. So looks like GLM-4.5 Air in 3bit quant is ahead. Chat is here: https://claude.ai/share/dc9eccbf-b34a-4e2b-af86-ec2dd83687ea https://claude.ai/share/dc9eccbf-b34a-4e2b-af86-ec2dd83687ea Claude Opus 4 does work but is far behind of Simon's GLM-4.5: https://claude.ai/share/5ddc0e94-3429-4c35-ad3f-2c9a2499fb5d https://claude.ai/share/5ddc0e94-3429-4c35-ad3f-2c9a2499fb5d
- slimebot80 1y ago(novice question) 64gb is pure RAM? I thought Apple Silicon was efficient at paging SSD as memory storage - how important is RAM if you've got a fast SSD?
- nicce 1y agoMemory speed is the most important factor with LLMs and SSD is very slow when compared to RAM.
- ethan_smith 1y agoWhile Apple Silicon's memory compression and SSD swapping are efficient, RAM access is still ~100x faster than SSD, so sufficient physical RAM remains crucial for memory-intensive workloads like running large LLMs.
- pmarreck 1y agoI have an M4 Mac with 128GB RAM and I'm currently downloading GLM-4.5-Air-q5-hi-mlx via LM Studio (80GB) and will report back!
- rexreed 1y agoHow is it going? Intrigued enough to possibly get an M4 Mac with 128GB RAM if it's worthwhile...
- ls-a 1y agoApple is going to make so much money if they keep pushing on-device LLMs. It makes absolute sense to sell more macbook pros
- pmarreck 1y agoAssuming they keep improving, yes. The one I tried (I responded to the other reply with some output, which was great) is as fast as the cloud ones and nearly as good.
- pmarreck 1y agoPretty impressive. Spit out perfectly-working Asteroids on the first try. https://gist.github.com/pmarreck/db782fdb68053292ca746d6c7569e2ac https://gist.github.com/pmarreck/db782fdb68053292ca746d6c756... I want to hook it up to Zed next and see how that goes
- matt3210 1y agoIs this more than ‘import space invaders; run_space_invaders()’?
- jauntywundrkind 1y agoMLX does have decent/good software support among ML stacks. Targeting both iOS and mac is a big win in itself. I wonder what's possible, what the software situation is today with the PC NPU's. AMD's XDNA has been around for a while, XDNA2 jumps from 10->40 TOps. AMD iGPU can access huge memory: is it similar here? The "AMDXDNA" driver merged in 6.14 last winter: where are we now? But not seeing any evidence that there's popular support in any of the main frameworks. https://github.com/ggml-org/llama.cpp/issues/1499 https://github.com/ggml-org/llama.cpp/issues/1499 https://github.com/ollama/ollama/issues/5186 https://github.com/ollama/ollama/issues/5186 Good news, AMD has an initial implementation of llama.cpp. I don't particularly know what it means, but the firt gen supports W4ABF16 quantization, newer chips support W8A16. https://github.com/ggml-org/llama.cpp/issues/14377 https://github.com/ggml-org/llama.cpp/issues/14377 . I'm not sure what it's good for, but there is a Linux "xdna-driveR", https://github.com/amd/xdna-driver https://github.com/amd/xdna-driver . IREE has an experimental backend: https://github.com/nod-ai/iree-amd-aie https://github.com/nod-ai/iree-amd-aie There's a lot of other folks also starting on their NPU journeys. ARM's Ethos, and Rockchip's RKNN recently shipped Linux kernel drivers, but it feels like that's just a start? https://www.phoronix.com/news/Arm-Ethos-NPU-Accel-Driver https://www.phoronix.com/news/Arm-Ethos-NPU-Accel-Driver https://www.phoronix.com/news/Rockchip-NPU-Driver-RKNN-2025 https://www.phoronix.com/news/Rockchip-NPU-Driver-RKNN-2025
- ygritte 1y agoCan you host that model locally with ollama?
- simonw 1y agoI haven't seen a GGUF for it yet, I imagine one will show up on Hugging Face soon which will probably work with Ollama.
- pyman 1y agoDo you think local LLMs combined with P2P networks could become a thing? Imagine people adding datasets to an open model, the same way they add blocks to a blockchain, which is around 500GB in size. It could help decentralise power and reduce our dependency on the big players.
- simonw 1y agoThere have been ambitions to do that kind of thing with LoRA - see the leaked "no moat" Google memo from a couple of years ago for one example: https://simonwillison.net/2023/May/4/no-moat/ https://simonwillison.net/2023/May/4/no-moat/ It hasn't really happened though. I suspect that's because it turns out techniques like RAG or tool calling are massively easier and more effective than trying to tech models new information through shared model weights.
- GardenLetter27 1y agoCrazy how Apple is still the only option for this consumer hardware.
- airspresso 1y agoFramework desktop with AMD Strix Halo [1] are getting there as a viable alternative. Offering up to 96 GB of unified RAM at the moment, so still a gap up to the beefiest Mac Studio alternatives though. [1]: https://frame.work/desktop https://frame.work/desktop
- GardenLetter27 1y agoSurprisingly competitive pricing there though. It sucks that they're all priced around $3k in total though (with my Europoor VAT), but it's not as bad vs. Apple as I thought it would be.
- xkcd1963 1y agoStandalone mini projects like that are also a good way to train students. But I believe LLMs are still a far long path away from being able to solve problems that require combination solutions like different environments, software, circumstances, projects, ...
- captainregex 1y agoWhat is the biggest group of people that uses local AI? Students who don’t want to pay but somehow have hardware? Devs who are price conscious? I kinda think about it like Linux- there’s an audience for it but most people will just use Windows. Are AI capabilities in a local device necessary even in whatever future self serving state some companies are pushing? It feels like we do it because we can more than because it makes sense- which I am all for! I just wonder if i’m missing some kind of major use case all around me