4 ms·
GPT-3 definitely has a writing style. I assume it would be detectable, ironically, by an AI.
by pclmulqdq 4y ago
GPT-3 definitely has a writing style. I assume it would be detectable, ironically, by an AI.
- sterlind 4y agoif it's detectable by an AI, you can GAN it into erasing its detectable writing style.
- joe_the_user 4y agoI think you could make the GPT's more undetectable by a computer using GAN techniques but that might well make the thing more detectable by a person. The GPT-style is something like rhetorical devices run together to make various claims unfold smoothly. An alternative approach could make the things inconsistency more obvious to a person.
- micromacrofoot 4y agoGPT-3 definitely has a writing style that can be detected by AI. But here's the thing: it's really easy to change its writing style. All you have to do is give it different input data and boom, you've got a whole new writing style.
- guelo 4y agoThat's not easy, it costs millions of dollars to obtain large amounts of clean data and retrain those models.
- magusdei 4y agoNo, it would take approximately 3 minutes where you either write a paragraph in the desired style yourself or paste one from the Internet and then ask it to continue in that style. Even if you decided to go the more onerous fine-tuning route, it would require 1-2mb of text, cost very little, and you'd be done in a few hours. It's easy.
- hansihe 4y agoBut you don't really have to retrain the whole model to modify it's writing style, fine tuning would probably be enough
- micromacrofoot 4y agoWell, that may be true, but even with a small amount of data, you can still change GPT-3's writing style to some extent. And you don't have to retrain the whole model from scratch, you can just fine-tune its existing settings to change its writing style.