3 ms·

I would recommend not having an AI write your README. Even if you didn't use AI for coding at all and the code works perfectly, it really doesn't inspire confid

I would recommend not having an AI write your README. Even if you didn't use AI for coding at all and the code works perfectly, it really doesn't inspire confidence.

WD-42 1y ago
Yup the second I saw the wall of text paragraph with all the emojis I had a sinking feeling the entire thing could be a vibe coded mess. Too bad because the project seems cool.
- typpilol 1y ago
  Makes me sad because I used to put a lot of effort into my readmes. Not insane amount of emojis but some and actually useful badges but not overkill. But in the end they always had nicely structured layouts etc.. I feel like I have to make mine sloppier now to pass the AI smell test
  - sandblast 1y ago
    Maybe it was also your style that the LLMs learned from (and then pushed more towards the extreme). Oh the irony.
    - typpilol 1y ago
      That would be even more sad
sandblast 1y ago
Well, most of commits have „brianathere and claude” as authors. Additionally, the style of comments in some of the files bears a strong resemblance to those typically generated by LLMs. Moreover, this whole thing has 7 stars on GitHub as of writing, and yet the bottom of README boldly claims „ready for production use”. For me, that overly confident approach discourages maybe even more.
adrian17 1y ago
The commit names look very weird too, feel more like marketing speak: > BREAKTHROUGH: Fix critical ID mismatch in Cap'n Web protocol > TIER 3 ULTIMATE: Extreme Stress Tests & Advanced Capability Composition > Achieve Cap'n Web protocol mastery with perfect capability composition (note: this exact commit name is repeated another time) The commit descriptions are even worse. If they’re so blatantly not written for anyone to read, why bother generating them at all?
- svieira 1y ago
  Yeah, LLM-created commit messages verge on "Brilliant Paula" for some reason. It's probably because nobody bothers to RLHF commit messages (yet). https://thedailywtf.com/articles/the_brillant_paula_bean https://thedailywtf.com/articles/the_brillant_paula_bean
- brian_meek 1y ago
  OP here. :-) (feel like I should put an emoji here). My focus as I "built" this was getting to a correct implementation, and putting in place guards and context to achieve that. As I moved through the process I added more and more ways to eval progress toward that. An area I didn't invest any of my effort in was commit messages, and some of them caused me to spit take as I saw them go by. I think this is something that can definitely be improved, and this conversation is fuel for thought on how to do this.

I would recommend not having an AI write your README. Even if you didn't use AI for coding at all and the code works perfectly, it really doesn't inspire confidence.

WD-42 1y ago

Yup the second I saw the wall of text paragraph with all the emojis I had a sinking feeling the entire thing could be a vibe coded mess. Too bad because the project seems cool.

typpilol 1y ago
Makes me sad because I used to put a lot of effort into my readmes. Not insane amount of emojis but some and actually useful badges but not overkill. But in the end they always had nicely structured layouts etc.. I feel like I have to make mine sloppier now to pass the AI smell test
- sandblast 1y ago
  Maybe it was also your style that the LLMs learned from (and then pushed more towards the extreme). Oh the irony.
  - typpilol 1y ago
    That would be even more sad

sandblast 1y ago

Well, most of commits have „brianathere and claude” as authors. Additionally, the style of comments in some of the files bears a strong resemblance to those typically generated by LLMs. Moreover, this whole thing has 7 stars on GitHub as of writing, and yet the bottom of README boldly claims „ready for production use”. For me, that overly confident approach discourages maybe even more.

adrian17 1y ago

The commit names look very weird too, feel more like marketing speak: > BREAKTHROUGH: Fix critical ID mismatch in Cap'n Web protocol > TIER 3 ULTIMATE: Extreme Stress Tests & Advanced Capability Composition > Achieve Cap'n Web protocol mastery with perfect capability composition (note: this exact commit name is repeated another time) The commit descriptions are even worse. If they’re so blatantly not written for anyone to read, why bother generating them at all?

svieira 1y ago
Yeah, LLM-created commit messages verge on "Brilliant Paula" for some reason. It's probably because nobody bothers to RLHF commit messages (yet). https://thedailywtf.com/articles/the_brillant_paula_bean https://thedailywtf.com/articles/the_brillant_paula_bean
brian_meek 1y ago
OP here. :-) (feel like I should put an emoji here). My focus as I "built" this was getting to a correct implementation, and putting in place guards and context to achieve that. As I moved through the process I added more and more ways to eval progress toward that. An area I didn't invest any of my effort in was commit messages, and some of them caused me to spit take as I saw them go by. I think this is something that can definitely be improved, and this conversation is fuel for thought on how to do this.