6 ms·
The Hugging Face GPT-2 detector (https://openai-openai-detector.hf.space/ https://openai-openai-detector.hf.space/) still does a good job identifying generic ch
by raylad 4y ago
The Hugging Face GPT-2 detector (https://openai-openai-detector.hf.space/ https://openai-openai-detector.hf.space/) still does a good job identifying generic chatGPT output.
But you can fool it by first asking chatGPT if it can write in the style of some known author, letting it output an example, then asking it to write about a given topic in the same style.
Here's generic output to "write a one paragraph description of Genghis Khan". The Hugging Face output detector says it's 99.98% likely to be fake (from GPT):
> Genghis Khan was a Mongolian warrior and ruler who founded the Mongol Empire, one of the largest empires in history. He is credited with uniting the nomadic Mongol tribes and establishing a powerful and efficient military force that conquered much of Asia and Europe in the 13th century. Genghis Khan is known for his strict code of law and his innovative use of cavalry and military strategy. He is also remembered for his brutal treatment of conquered peoples, as he and his armies were responsible for the deaths of millions of people during their conquests.
But this response, in the style of Charles Bukowski, gets a 98.66% real (not GPT) rating by the checker:
> Genghis Khan was a man of fire and fury, a conqueror who swept across the land like a storm. His armies were vast and unstoppable, crushing all who opposed him beneath their hooves. He was a man of vision and determination, who united the scattered tribes of the steppes and forged them into a mighty nation. But he was also a man of blood and death, who left a trail of destruction in his wake. Villages were burned and pillaged, their inhabitants slaughtered or taken as slaves. The world trembled at the mention of his name, and even the greatest kings and emperors bowed before him in fear. Such was the power of Genghis Khan, the greatest warrior the world had ever known.
- m463 4y agoYou might have helped students cheat... But wow, the second response was pretty exciting. I wonder if chatgpt can get present-day authors to up their game?
- raylad 4y agoIf I can figure it out in a couple of minutes, everyone else would figure it out too. By the way, here's the response to "can you write in the style of Charles Bukowski?" (the first prompt in the session): > Sure! Here's a little something I came up with: "I woke up this morning with a hangover and a broken heart. The bottle was empty, just like my bank account. Love had come and gone, leaving nothing but pain and regret in its wake. I stumbled out of bed and into the shower, hoping the water would wash away the memories of her. But as I stood there, staring at the peeling paint and the mildew on the walls, I knew that the only thing that would cure me was time and more whisky. So I dressed myself in my finest rags and headed out into the city, searching for the next fix, the next distraction, the next moment of fleeting pleasure that would take me away from the pain. Because in the end, that's all we really have: the present moment and the hope that tomorrow will be better, or at least no worse than today."
- orangepurple 4y agoYou give others way too much credit
- tester457 4y agoThis is a common idea on gpt forums, everyone on those thinks they're the first to come up with it.
- beepbooptheory 4y agoThis does not really read like Bukowski at all..
- Pet_Ant 4y agoI wonder what would happen if you fed the Robert Jordan novel Brandon Sanderson had to finish and asked GPT to rewrite them in Robert Jordan's style. Then review the diffs and use that to do an edit.
- meltyness 4y ago> His armies were vast and unstoppable, crushing all who opposed him beneath their hooves. Within the context, this is a ambiguous in a way that would be unrealistic, like a bit of a micro-Chekhov's gun.
- lupire 4y agoHugging Face detector is just "GPT default style" detector? And the style isn't even the bad part of GPT.
- Cerotti 4y ago[flagged]