4 ms·

I find all of these .md files released by the labs to be ai generated slop. The only exception being maybe the /simplify command

tantalor 5mo ago
No surprise there. Of course the skill files are not human written. The AI is an expert in both following and generating prompts.
- sumeno 5mo ago
  Why do you think it is an expert in generating prompts? It has no additional insight into how it works internally than anyone else
  - scottyah 5mo ago
    Do you really think a random person off the street knows more about how LLMs work internally than the latest frontier model (that has been trained on that material)?
    - sumeno 5mo ago
      No, but a random person off the street also isn't making skills for LLMs. I think that LLMs are trained on the millions of vibe written LLM blog posts that are more superstition than fact. There is a lot of snake oil out there that is treated as fact. If someone claims that an LLM is better than humans at something I always want to see the rigorous evaluations that have been done to quantify it, not "but they're trained on everything!"
- rubenflamshep 5mo ago
  Hmmm, I disagree. The AI is exceedingly average at everything it does and requires an expert human-in-the-loop to catch things that appear plausible but are slop. To that degree I think there is a difference between "AI generated" and slop.
sothatsit 5mo ago
It still surprises me how effective the /simplify skill is. I’ve also had some great results with a /reflect skill that asks the agent to look at the work in the broader context of the project. But those are the only two skills I use regularly that aren’t specific to our company, codebase, or tools.
- rubenflamshep 5mo ago
  Some engineers I work with have had less than desirable results with /simplify but it overall seems to work! I used to use some of the humanlayer subagents but they haven't been updated in several months
subscribed 5mo ago
"Claude, build me 50 skills an Account Analyst would find useful, then run them through the agent at maxxxx thinking and ship the top 10 of them" My money's on that.

tantalor 5mo ago

No surprise there. Of course the skill files are not human written. The AI is an expert in both following and generating prompts.

sumeno 5mo ago
Why do you think it is an expert in generating prompts? It has no additional insight into how it works internally than anyone else
- scottyah 5mo ago
  Do you really think a random person off the street knows more about how LLMs work internally than the latest frontier model (that has been trained on that material)?
  - sumeno 5mo ago
    No, but a random person off the street also isn't making skills for LLMs. I think that LLMs are trained on the millions of vibe written LLM blog posts that are more superstition than fact. There is a lot of snake oil out there that is treated as fact. If someone claims that an LLM is better than humans at something I always want to see the rigorous evaluations that have been done to quantify it, not "but they're trained on everything!"
rubenflamshep 5mo ago
Hmmm, I disagree. The AI is exceedingly average at everything it does and requires an expert human-in-the-loop to catch things that appear plausible but are slop. To that degree I think there is a difference between "AI generated" and slop.

sothatsit 5mo ago

It still surprises me how effective the /simplify skill is. I’ve also had some great results with a /reflect skill that asks the agent to look at the work in the broader context of the project. But those are the only two skills I use regularly that aren’t specific to our company, codebase, or tools.

rubenflamshep 5mo ago
Some engineers I work with have had less than desirable results with /simplify but it overall seems to work! I used to use some of the humanlayer subagents but they haven't been updated in several months

subscribed 5mo ago

"Claude, build me 50 skills an Account Analyst would find useful, then run them through the agent at maxxxx thinking and ship the top 10 of them" My money's on that.