3 ms·
Since there’s no access to the ground truth here—including for Clarke—all we (or he) really know, even if this is completely honest from Clarke’s perspective, i
by dragonwriter 4y ago
Since there’s no access to the ground truth here—including for Clarke—all we (or he) really know, even if this is completely honest from Clarke’s perspective, is that there is an increase in aggregate submissions and more authors are being banned for subjective reasons that Clarke believes correlate to being AI generated.
The timing may be fairly strong evidence that the source of the surge is generated AI, but whether the bans correspond to use of that significantly better than random chance is supposition. For all anyone (except the individual submitters) knows, there is just as much generative AI use in the ones getting accepted as those being rejected.
- erehweb 4y agoWith respect, I don't think anyone who writes publishable SF believes that generative AI on its own can write to Clarkesworld publishable quality.
- dragonwriter 4y agoEven if no AI generated works are getting through, without access to the ground truth and empirical evidence that the “AI detection” heuristics + manual review are actually rejecting AI exclusively (or at least at a rate *higher than the rate at which AI works are represented among the subset of submissions below publishable quality), what this actually is is an arbitrary addition of lifetime bans for failing to meet arbitary quality standards with a single submission, masquerading as AI detection. Which is perfectly within Clarke’s rights, before the people making that argument jump in, but lets not pretend its anything other than what it is. Clarkesworld doesn't have a magical generative AI detecting ability that the solutions tested with access to the ground truth (which, yes, still suck pretty badly) lack.
- em-bee 4y agowe don't know what the criteria are, and we have to take their word for it that they are some obvious markers that something is AI generated, and as neil explains in the comments below: it includes many indicators that go beyond the story itself, so it is most certainly not just quality standards. also not having access to the criteria does not make them arbitrary. i trust that the criteria are well reasoned.
- em-bee 4y agoas neil wrote earlier here: https://clarkesworldmagazine.com/clarke_04_23/ https://clarkesworldmagazine.com/clarke_04_23/ "We soon discovered, however, that these submissions were coming from outside the science fiction and fantasy community" so with the exception of new authors that are unknown in the community, most submissions are from known authors and certainly not AI generated. there would have to be a significant number of submissions from new authors if AI was capable of creating quality works. since that is not the case we can conclude that AI is not (yet) capable of that.