4 ms·

I love this experiment and am surprised that the Claude models performed that much better than the competition. Opus was particularly impressive both in the qua

I love this experiment and am surprised that the Claude models performed that much better than the competition. Opus was particularly impressive both in the quality itself and the ability to iterate meaningfully. Now... Was this article LLM written? This part triggered all my LLM flags: ``` Adding a bicycle chain isn’t just decoration—it shows understanding of mechanical relationships. The wheel spokes, the adjusted proportions—these are signs of vision-driven refinement working as intended. ```

kfarr 11mo ago
I mean at some point you have to evaluate the content on its merit and they have a point — a chain is functional not just decorative in its precise placement.
- bcoates 11mo ago
  That phrase template isn’t just overdone—it's something some text models are obsessed with. The em-dashes, the contrastive language—these are signs of LLMs being asked to summarize or expand a compelling blog post.
- awaikour 11mo ago
  Evaluating the content on its merit I'd question whether the author has seen a bicycle before. Yes, in the final iteration with Opus it added a chain, but it's missing a triangle which clearly shows a lack of understanding of mechanical relationships. Ignoring the wording, em-dashes, etc. I'd assume an LLM not only wrote the article but also judged the pictures. That or the author has a much more relaxed opinion on what a pelican on a bicycle should actually look like. I don't think I would call Sonnet's arms and handlebars improved, nor would I call Haiku's legs and feet "proper." And if you overlay GPT-5 Medium's two photos the shapes proportions are nearly identical.
- boxed 11mo ago
  If you give it credit for the chain, you need to also notice that that bike has a fixed front wheel. It literally can not be turned.
  - junga 11mo ago
    Humans are super bad at drawing bikes: https://www.gianlucagimini.it/portfolio-item/velocipedia/ https://www.gianlucagimini.it/portfolio-item/velocipedia/ Does being bad at drawing bikes make a machine more intelligent/human?
  - zamadatix 11mo ago
    How do you know the wheel is fixed?
    - boxed 11mo ago
      There's a bar going from the front wheel axis to the saddle. The only way that wheel can be twisted is if that bar allows in-axis rotation. That's now how steering on a bike works.
      - zamadatix 11mo ago
        Ahhh yes of course - turned. For some reason my mind ran with that as spun. Thanks!
        boxed 11mo ago
        haha, yea then I understand the confusion :P
rsanheim 11mo ago
Did not feel LLM written to me - at least not overtly so. LLM editing/assisted perhaps? It was a fun little post that felt accurate (ie confirmed my own biases ;)) about the current state of LLM models in a silly, but real, use-case. The continual drive to out "llm written" articles feels a bit silly to me at this point. They are now part of the tools and tech we use, for better or worse. And to be clear, I think in a lot of cases it leans towards 'worse'. But do you question if a video or photo was made with digital editing or filters or 'ai' tools (many of which we've had for years, just under different names) ? Do you worry about what tech was used in making your favorite album or song? I get it, LLMs make it easy to produce trash content, but this is not a new problem. If you see trash, call it out as trash on its flaws, not on a presumption of how it was made.
- weedhopper 11mo ago
  What an insightful comment! (sorry, couldn’t help it) I agree about the silliness. God forbid i am a non-native English speaker and I have a bit of an of odd writing style in a real Brits eye. Or that I use ‘—‘ instead of ‘-‘ because usually typing two dashes converts to the long one on Mac (try even four, technology is crazy these days), and it just feels a bit nicer. OR that I adopt occasional use of ‘;’ because I feel like it (Yes. English is supposed to have short sentences. Unlike other languages. Beautiful. Sue me.) I don’t care if they helped themselves with AI to improve writing or turn a bullet point into a sentence. It’s when the volume of text doesn’t justify the lack of content or value that I call bs and go to the next one. At this point it might as well be human generated content, but I don’t care, outcome’s the same. Regarding the post — it’s a cute little article and the pelicans do seem be making a point with their funky shapes
- huevosabio 11mo ago
  No, I don't have anything against using LLMs to write. My problem is that I enjoy reading people in part for diversity of style. I already spend too much time reading LLM outputs on my own interactions. And I get sick of their style because of it. So when I read it during leisure time, it just triggers a gut rejection. Especially because they are so formulaic / template-y.

kfarr 11mo ago

I mean at some point you have to evaluate the content on its merit and they have a point — a chain is functional not just decorative in its precise placement.

bcoates 11mo ago
That phrase template isn’t just overdone—it's something some text models are obsessed with. The em-dashes, the contrastive language—these are signs of LLMs being asked to summarize or expand a compelling blog post.
awaikour 11mo ago
Evaluating the content on its merit I'd question whether the author has seen a bicycle before. Yes, in the final iteration with Opus it added a chain, but it's missing a triangle which clearly shows a lack of understanding of mechanical relationships. Ignoring the wording, em-dashes, etc. I'd assume an LLM not only wrote the article but also judged the pictures. That or the author has a much more relaxed opinion on what a pelican on a bicycle should actually look like. I don't think I would call Sonnet's arms and handlebars improved, nor would I call Haiku's legs and feet "proper." And if you overlay GPT-5 Medium's two photos the shapes proportions are nearly identical.
boxed 11mo ago
If you give it credit for the chain, you need to also notice that that bike has a fixed front wheel. It literally can not be turned.
- junga 11mo ago
  Humans are super bad at drawing bikes: https://www.gianlucagimini.it/portfolio-item/velocipedia/ https://www.gianlucagimini.it/portfolio-item/velocipedia/ Does being bad at drawing bikes make a machine more intelligent/human?
- zamadatix 11mo ago
  How do you know the wheel is fixed?
  - boxed 11mo ago
    There's a bar going from the front wheel axis to the saddle. The only way that wheel can be twisted is if that bar allows in-axis rotation. That's now how steering on a bike works.
    - zamadatix 11mo ago
      Ahhh yes of course - turned. For some reason my mind ran with that as spun. Thanks!
      - boxed 11mo ago
        haha, yea then I understand the confusion :P

rsanheim 11mo ago

Did not feel LLM written to me - at least not overtly so. LLM editing/assisted perhaps? It was a fun little post that felt accurate (ie confirmed my own biases ;)) about the current state of LLM models in a silly, but real, use-case. The continual drive to out "llm written" articles feels a bit silly to me at this point. They are now part of the tools and tech we use, for better or worse. And to be clear, I think in a lot of cases it leans towards 'worse'. But do you question if a video or photo was made with digital editing or filters or 'ai' tools (many of which we've had for years, just under different names) ? Do you worry about what tech was used in making your favorite album or song? I get it, LLMs make it easy to produce trash content, but this is not a new problem. If you see trash, call it out as trash on its flaws, not on a presumption of how it was made.

weedhopper 11mo ago
What an insightful comment! (sorry, couldn’t help it) I agree about the silliness. God forbid i am a non-native English speaker and I have a bit of an of odd writing style in a real Brits eye. Or that I use ‘—‘ instead of ‘-‘ because usually typing two dashes converts to the long one on Mac (try even four, technology is crazy these days), and it just feels a bit nicer. OR that I adopt occasional use of ‘;’ because I feel like it (Yes. English is supposed to have short sentences. Unlike other languages. Beautiful. Sue me.) I don’t care if they helped themselves with AI to improve writing or turn a bullet point into a sentence. It’s when the volume of text doesn’t justify the lack of content or value that I call bs and go to the next one. At this point it might as well be human generated content, but I don’t care, outcome’s the same. Regarding the post — it’s a cute little article and the pelicans do seem be making a point with their funky shapes
huevosabio 11mo ago
No, I don't have anything against using LLMs to write. My problem is that I enjoy reading people in part for diversity of style. I already spend too much time reading LLM outputs on my own interactions. And I get sick of their style because of it. So when I read it during leisure time, it just triggers a gut rejection. Especially because they are so formulaic / template-y.