4 ms·

Just had a thought, what if you made new contributors write a human-authored essay on why they’re submitting a patch, and then check it against Pangram? Pangram

• aleph_minus_one 1mo ago
  > Just had a thought, what if you made new contributors write a human-authored essay on why they’re submitting a patch, and then check it against Pangram? The problem is writing such an essay takes magnitudes more of an effort for people who are not native English (or whatever the language is in which discussions are done about the project) speakers. Also, relatedly, essays written by non-native English speakers often get considered to be AI-written by common AI detection systems, even though no AI was involved when writing them; see for example > I'm Kenyan. I Don't Write Like ChatGPT. ChatGPT Writes Like Me. > https://marcusolang.substack.com/p/im-kenyan-i-dont-write-like-chatgpt https://marcusolang.substack.com/p/im-kenyan-i-dont-write-li...
  • sebmellen 1mo ago
    I’m as skeptical of the AI writing detection as anyone else, but I’ve been trying to beat Pangram v4 for the last week and it’s essentially impossible.
    • sarchertech 1mo ago
      Have you tried in both directions though? You need to test both sensitivity and specificity.
      • sebmellen 1mo ago
        Yes. It’s scarily accurate. They have a blog post on it if you look up “Pangram v4 System Card“