4 ms·

In some alternate timeline an enterprising person at OpenAI has written a memo in which they requested a new service to be implemented. This service hashes all

In some alternate timeline an enterprising person at OpenAI has written a memo in which they requested a new service to be implemented. This service hashes all generated responses before they are sent to the end user and saves each hash in a db somewhere. After OpenAI’s products have become popular enough that plagiarism is a valid concern, OpenAI releases their (paid) generated response history API which allows you to provide a hash and get a response as to whether or not it exists in their database. This puts a stop to 85% of all low effort plagiarism and earns OpenAI a decent additional revenue stream.

neodymiumphish 4y ago
You'd have to have the hashes based on small portions of the responses, in order to catch copies where the recipient made minor changes throughout.
- gruez 4y ago
  Sounds like a reason to partner with turnitin.
- comboy 4y ago
  Shazam but for text. You read a good article so you wonder which bot made this. You've heard it here first.
- g_p 4y ago
  This sounds like a good opportunity for fuzzy hashes like SSDEEP. This ought to give enough flexibility to detect minor tweaks to output. https://www.microsoft.com/en-us/security/blog/2021/07/27/combing-through-the-fuzz-using-fuzzy-hashing-and-deep-learning-to-counter-malware-detection-evasion-techniques/ https://www.microsoft.com/en-us/security/blog/2021/07/27/com...
- wkat4242 4y ago
  And then you have the issue of those small parts being so common that they could match even normal English. It's not an easy problem to solve :(
tkiolp4 4y ago
But that would immediately scare away all the future potential OpenAI customers… why would OpenAI do that? If customers know that it’s possible to determine that a text came from ChatGPT with a 100% accuracy, then no one would use ChatGPT.
- paulryanrogers 4y ago
  Why? This assumes the only market is for cheaters and those seeking ghost writers.
  - unethical_ban 4y ago
    It is. The world, society, is not prepared for a scenario where computers generate human quality copy. This is hugely disruptive and will be used by workers and students to cheat their classes and do their work for them for a while. It's a disruptive technology.
  - tkiolp4 4y ago
    Not the only market, but a big part of it. People who work on social media will definitely make use of ChatGPT… unless Twitter, FB, et. al start to label tweets and messages with “Written by ChatGPT”. Same goes for anything that has to do with selling written words. Not a small market precisely.
  - sli 4y ago
    Because it is for ghost writers or to act as the ghost writer. What good is a text generating AI otherwise if you're not generating text to present as though it's your own? Even if the text is accurate, it's still ghost writing unless the whole point is to specifically present an AI-generated piece of text as AI-generated (aka pure novelty). AI written articles, for example, aren't doing that.
    - jhbadger 4y ago
      There are many, many uses for a text generating AI other than for nefarious purposes. It can give suggestions for things to do, it can write short stories to amuse you, it can act as an RPG game master, it can help with language learning, and so on. Assuming that it is only for cheaters is like how the music and film industry assumed that the only purpose for ripping CDs and DVDs onto your computer was to pirate them, ignoring that many people wanted to have a media server to stream their legally purchased media within their own homes.
geysersam 4y ago
A minor edit in the document completely changes the hash. And if it doesn't, we agan have the question if this is just a false positive.
- fidgewidge 4y ago
  There are similarity based hashes.
- anticensor 4y ago
  There are non-cryptographic digest hashes that do not exhibit an avalanche effects.
maltalex 4y ago
Changing a single letter in the response will defeat such a system.

neodymiumphish 4y ago

You'd have to have the hashes based on small portions of the responses, in order to catch copies where the recipient made minor changes throughout.

gruez 4y ago
Sounds like a reason to partner with turnitin.
comboy 4y ago
Shazam but for text. You read a good article so you wonder which bot made this. You've heard it here first.
g_p 4y ago
This sounds like a good opportunity for fuzzy hashes like SSDEEP. This ought to give enough flexibility to detect minor tweaks to output. https://www.microsoft.com/en-us/security/blog/2021/07/27/combing-through-the-fuzz-using-fuzzy-hashing-and-deep-learning-to-counter-malware-detection-evasion-techniques/ https://www.microsoft.com/en-us/security/blog/2021/07/27/com...
wkat4242 4y ago
And then you have the issue of those small parts being so common that they could match even normal English. It's not an easy problem to solve :(

tkiolp4 4y ago

But that would immediately scare away all the future potential OpenAI customers… why would OpenAI do that? If customers know that it’s possible to determine that a text came from ChatGPT with a 100% accuracy, then no one would use ChatGPT.

paulryanrogers 4y ago
Why? This assumes the only market is for cheaters and those seeking ghost writers.
- unethical_ban 4y ago
  It is. The world, society, is not prepared for a scenario where computers generate human quality copy. This is hugely disruptive and will be used by workers and students to cheat their classes and do their work for them for a while. It's a disruptive technology.
- tkiolp4 4y ago
  Not the only market, but a big part of it. People who work on social media will definitely make use of ChatGPT… unless Twitter, FB, et. al start to label tweets and messages with “Written by ChatGPT”. Same goes for anything that has to do with selling written words. Not a small market precisely.
- sli 4y ago
  Because it is for ghost writers or to act as the ghost writer. What good is a text generating AI otherwise if you're not generating text to present as though it's your own? Even if the text is accurate, it's still ghost writing unless the whole point is to specifically present an AI-generated piece of text as AI-generated (aka pure novelty). AI written articles, for example, aren't doing that.
  - jhbadger 4y ago
    There are many, many uses for a text generating AI other than for nefarious purposes. It can give suggestions for things to do, it can write short stories to amuse you, it can act as an RPG game master, it can help with language learning, and so on. Assuming that it is only for cheaters is like how the music and film industry assumed that the only purpose for ripping CDs and DVDs onto your computer was to pirate them, ignoring that many people wanted to have a media server to stream their legally purchased media within their own homes.

geysersam 4y ago

A minor edit in the document completely changes the hash. And if it doesn't, we agan have the question if this is just a false positive.

fidgewidge 4y ago
There are similarity based hashes.
anticensor 4y ago
There are non-cryptographic digest hashes that do not exhibit an avalanche effects.

maltalex 4y ago

Changing a single letter in the response will defeat such a system.