5 ms·
Generating software still token costs, generating something like ms-word will still cost a significant amount, takes a lot of human effort to prompt and validat
by ako 6mo ago
Generating software still token costs, generating something like ms-word will still cost a significant amount, takes a lot of human effort to prompt and validate. Having a proven solution still has value.
- lrvick 6mo agoYou can already generate surprisingly complex software on an LLM on a raspberry pi now, including live voice assistance, all offline. Peoples hardware can self write software pretty readily now. The cost of tokens is a race to zero.
- ako 6mo agoThat is not what i'm seeing. I've been coding intensively with claude code for the last 3 months: 200k lines of go, 1200+ commits, mostly using opus. I don't think i could have done this with a local LLM. Maybe on a M5 pro?
- lrvick 6mo agoQwen 3.5 122b is competitive with Opus 4.6, and runs at 35t/s on a Strix Halo. It is my daily driver. Unlike Opus I can run abliterated models with censorship removed so it can be used for security research and reverse engineering and whatever I want with privacy, offline. It makes any hosted models feel like a kids toy.