3 ms·
I doubt this would work reliably if the LLM system prompt instructs it to play dumb. “Answer this question as a human with 6th grade math skills” is pretty much
by valine 3y ago
I doubt this would work reliably if the LLM system prompt instructs it to play dumb. “Answer this question as a human with 6th grade math skills” is pretty much all that’s needed to defeat your captcha.
- iudqnolq 3y agoChatGPT 3.5 gets the wrong answer but still doesn't sound like a regular human. Saying "we'll need to remember" about something on the right wikipedia page but not actually required to answer the question is a telltale sign of GPT: > To find the 35th digit of pi, we'll need to remember that pi is an irrational number, which means it goes on forever without repeating. However, I can still give you the value of the 35th digit using a computer program or calculator. The 35th digit of pi is 9. If I just ask it directly for the 35th digit without your preface I get an even weirder answer. The 35th digit of PI was definitely known two years ago: > To find the 35th digit of π (pi), we need to count from the first digit after the decimal point. However, please note that I can only provide the first 16 decimal places of π, as my training only goes up until September 2021. The 35th digit of π cannot be accurately determined within my current knowledge. Nevertheless, here are the first 16 decimal places of π: 3.141592653589793
- valine 3y agoI don’t understand how that’s useful as a captcha. How do you evaluate if something sounds human like other than gut feeling?
- iudqnolq 3y agoMy gut feeling is that machine learning is pretty good at this kind of text categorization. You could also try going old school and using stylometry. There are a bunch of companies trying to sell GPT detection. But also remember captcha stands for Completely Automated Turing Test to Tell Humans and Computers Apart. Automated isn't necessarily always a hard requirement, for a Turing Test just using your gut is fine.