3 ms·
At the high school level especially? I just asked it to write an essay on the Battle of Agincourt. Perfectly serviceable prose that looks accurate to me. I'm s
by ghaff 4y ago
At the high school level especially?
I just asked it to write an essay on the Battle of Agincourt. Perfectly serviceable prose that looks accurate to me. I'm sure I could flesh it out using some follow-on questions. What were the causes? Describe the reign of Henry V. Describe the English tactics and why they won. Etc.
Add a few convincing references to any of the doubtless many books on the subject for sale on Amazon and I could have a perfectly adequate high school or maybe even low-level college essay in an hour tops.
(And I did run some random sentences through Google looking for exact matches and didn't find them.)
The Battle of Agincourt was a significant event in English and French history, as it was a major victory for the English army against the French during the Hundred Years' War. The battle took place on October 25, 1415, near the town of Agincourt in northern France.
The English army, led by King Henry V, was vastly outnumbered by the French forces, which were estimated to be around 30,000 soldiers compared to the English army of just 6,000. Despite the odds, the English were able to emerge victorious thanks to their superior tactics and weaponry.
The English army was composed of mostly longbowmen, who were able to shoot arrows with great accuracy and power. The French, on the other hand, relied heavily on heavily-armored knights, who were less effective in the muddy and wet conditions of the battlefield. The English were also able to take advantage of the narrow front of the battlefield, which allowed them to focus their firepower and overwhelm the French forces.
The battle lasted for several hours and was marked by intense hand-to-hand combat. In the end, the English emerged victorious, with the French suffering heavy casualties. The English lost only a few hundred soldiers, while the French lost thousands.
The victory at Agincourt was a major turning point in the Hundred Years' War, as it weakened the French army and boosted English morale. It also cemented King Henry V's reputation as a great military leader and helped to solidify English control over parts of France.
The Battle of Agincourt is still remembered today as a key event in English and French history, and it continues to be celebrated in popular culture, such as in Shakespeare's play "Henry V." Overall, it was a significant military victory for the English and a crucial moment in the history of the Hundred Years' War.
- dr_zoidberg 4y agoI'm answering both you and the previous one in the chain. I used huggingface's OpenAI detector[0], the pizza example is detected as fake with 99.98% probability, whereas the Battle of Agincourt text is also reported as fake with over 99% probability. I don't have any example at hand of how much "real" text on these topics to try and see what that model detects, but up to this point[1] this text is reported as 99% real. You can play and see how much % it assigns to different examples.[2] [0] https://huggingface.co/openai-detector https://huggingface.co/openai-detector [1] I had to cut somewhere to copy and paste into the detector, so [1] is the cutting point [2] My whole response was still detected as 99.98% real, and copy-pasting the Agincourt bit at the end still reported as 99.98% real. However, moving it to the start (having my answer as a last paragraph) made it detect as 97.71% real. Deleting only "huggingface's" balanced it as 54% real. You can play around with the demo to test different variations of any text you analyze with it.
- ghaff 4y agoYou play with ChatGPT a bit and you do start to see certain patterns in the results. So I guess if you train on the outputs it gets relatively straightforward to recognize other examples that are just cut and pasted from the ChatGPT--even if, in isolation, it seems like something a person might write.
- dr_zoidberg 4y agoThe "weird" (or "funny" or whatever you want to call it) thing is that the detector I linked was originally made for GPT-2, but still works reasonably well for GPT-3 (and derived) output.
- Al-Khwarizmi 4y agoVery interesting, I didn't know that detector. But making small local changes, it's easy to make the probability of "fake" go down, while still benefitting from the automatically-written essay. As long as students have access to the same tools as teachers, it will be easy for them to get away with automatically generated essays.