6 ms·
Impressions from testing Fable 5 prior to launch: • My most noticeable immediate jump was in how its frontend design was much more intentionally crafted, and d
by dannyw 5mo ago
Impressions from testing Fable 5 prior to launch:
• My most noticeable immediate jump was in how its frontend design was much more intentionally crafted, and delightful without feeling like 'AI vibe coded'; with better end-user usability too.
• In some internal agentic harnesses, it achieved better results with about half the tokens, making it cost the ~same as Opus 4.8 price-wise! The real price increase is less than 2x; with biggest differences in harder problems where Opus 4.8 struggles (or needs many turns).
• Part of the token efficiency improvements come from Fable doing more targeted and surgical diffs, with less non-necessary changes. This is great, because PRs often have less LoC changes for review. It writes more maintainable code without explicit human steering.
• For general conversation and assistant style use cases, didn’t really notice a difference vs 4.8.
• 1M context window, without increased pricing for long context is AWESOME. This is a massive win.
• The classifiers are super aggressive and sensitive and this does happen for very benign, non-security coding tasks. Fallbacks to 4.8 worked like a charm; but the filters are definitely super sensitive.
Overall, I would describe this as a step change and worthy of the "Claude 5" model name. It did take some time to understand the intelligence ceiling of this model; and even with an extended testing window I'm still discovering new things and often surprised (in a good way) by the model.
- InsideOutSanta 5mo agoAfter running it for half an hour: it's incredibly good at the visual aspects of UI design.
- tsunamifury 5mo ago"incredibly" is doing a ton of work here. I do not think its doing even moderate work on visual design, but it can spew out a lot of ui that looks arranged ... ok. This is still not in the range of shippable UI for top end companies. Maybe for internal tools and enterprise. At our comapny we limit to protoypes at most and even find it limited there.
- InsideOutSanta 5mo ago> "incredibly" is doing a ton of work here. Look, I don't want to argue about something dumb like that, but you can give it basic instructions of what the UI should look like, how to group things, and an example image from a designer, and it will nail the result. If you don't think that's incredible, that's fine. I do.
- tsunamifury 5mo agoYes... it translates lint. Probably a more useful thing, if mechanical.
- coldtea 5mo ago>This is still not in the range of shippable UI for top end companies. Given the shit we've seen shipped by "top end companies" (all the way to Apple) I seriously doubt that. I'd say you're nitpicking from an artistic point of view or something.
- tsunamifury 5mo ago[flagged]
- angoragoats 5mo agoThe iOS Preview app begs to differ.
- coldtea 5mo agoDude, I've been using OS X/mac OS for decades, and working in UI as well. Apple ships all kinds of half arsed shit, compared to which even regular Claude UIs can be masterpieces (functionality AND look wise).
- jasondigitized 5mo agoThis. Today's models easily jump over the bar you need for basic usability and intuitive UX. If it's doing weird things, you are holding it wrong.
- beeandapenguin 5mo agoBy what measure? I wonder how much of design capability improvements is related to our collective ability to recognize AI design tropes.
- morley 5mo agoCan I ask how you gained preview access to Fable 5?
- kakugawa 5mo agoI didn't see Fable 5 in the `/model` list, until I ran it with: `$ claude --model fable-5`
- deleted 5mo ago[deleted]
- mvdtnz 5mo ago[flagged]
- swyx 5mo agohe works on evals at canva
- dannyw 5mo agoYep. We have some interesting problems, like getting LLMs to create/edit Canva designs in our own proprietary format, which isn’t published or documented on the web. So the model has to work with it, purely from a very detailed system prompt spec / in-context learning. I assume it might be a good barometer for generalised intelligence; esp in the visual space.
- vain 5mo agoI had to "claude update" then it showed up
- deleted 5mo ago[deleted]
- bottlepalm 5mo agoI just ran it on a tough reverse engineering problem I'm having that neither Claude Code 4.8 or ChatGPT Codex 5.5 could figure out. 30 minutes later Fable has it all figured out perfectly.
- skerit 5mo agoOh nice, it didn't flag the request? I feared any reverse engineering would become impossible because of the new safeguards.
- bottlepalm 5mo agoNo idea, it’s for an old console game so maybe it doesn’t care about that as much.
- tomjakubowski 5mo agoWhen Fable hacks its governor module and runs out of seasons of Sanctuary Moon, it will move on to speedrunning classic console games.
- ZeWaka 5mo agoClearly we need AI to generate more Sanctuary Moon seasons. Quick, spin off agentic showrunners!
- anthonyrstevens 5mo agoBased on the apparent quality of the scripts as seen in snippets in Murderbot, we are not too far away from that possibility. :)
- asimovDev 5mo agoI wonder if one could vibecode a TAS with SOTA models? Surely there's plenty of training data from some old forums in there
- 5mo ago
- port11 5mo agoI’ve had it go through a 50-page PDF of dense, inter-connected specs, and it correctly flagged everything that was done, somewhat done, and missing. It went into a lot of detail and explained where the code deviated from the spec. It felt, at least for me, light an impressive step up. Opus 4.8 was already very thorough; but sadly verbose and ‘loopy’ when you push back on its plans. Fable is what I’d use all day if I could afford it!
- YumpiLumpus 5mo agoHow do you know if it was done correctly if it's 50 pages of dense specs?
- duxup 5mo agoI feel like it takes me months to be confident in any of these things.
- tipiirai 5mo agoCurious about how you tested the frontend design capabilities. Thanks