3 ms·
I successfully used a GPT-2 output identification tool to see whether something was generated using ChatGPT. I think it only works if the text has a minimum num
by hiidrew 4y ago
I successfully used a GPT-2 output identification tool to see whether something was generated using ChatGPT. I think it only works if the text has a minimum number of characters. I imagine it's only a matter of time until Turnitin integrates something like this, or some other start-up comes along in edtech. Either way, the continuous arms race on generative media / identification of it will be fascinating to watch as it unfolds!
- hiidrew 4y agoI think this was the tool I tested it out- https://huggingface.co/openai-detector https://huggingface.co/openai-detector
- ivegotnoaccount 4y agoWell, as explained in some of my other comments, it doesn't seem that effective. Most GPT-generated garbage will probably be GPT-3 based, which doesn't seem to too often trigger as "fake" (got more "human" results when I tested it with ChatGPT), while on the other hand, it says that several of my comments are fake with >99% certainty.
- hiidrew 4y agoI see, that's obviously an issue. I only tested it with something I generated and someone's long form blog post.
- deleted 4y ago[deleted]