10 ms·
AI Submissions to Clarkesworld Continue
- arcbyte 3y agoIn the very near future, every HTML form submission is going to require a market-rate fee to be processed, precisely to deal with spam. I'm surprised it's taken this long actually.
- swayvil 3y agoI foresee a boom in the proofreading industry. Proofreading these AI excretions. For veracity, productizability. Picking painstakingly through walls of synthetic bullshit. It will be a new height in excruciating labor. Interesting new mental diseases will arise.
- Taek 3y agoMaybe we will finally get a robust ecosystem of micropayments on the web
- ilamont 3y agoEven a token fee - refundable to proven works of human authorship - would take care of most spam. The dogmatic response to these and similar suggestions is “under no circumstances will authors ever have to pay to publish” often citing situations such as authors who are too poor to pay a token fee or don’t have access to online payments.
- kayodelycaon 3y agoAny infrastructure designed to accept fees will be used for verifying stolen credit cards. You need to have countermeasures implemented for this. (Or whoever you use will need to.) Also, a high refund rate will nuke your merchant account with most processors. No one wants to deal with this business model.
- ftth_finland 3y agoThis is a solved problem: 3-D Secure
- em-bee 3y agoi disagree that the rejection of pay systems is dogmatic. clarkesworld has already published authors who could not make such payments, so clearly any payment system would have prevented those stories from reaching us and we would have missed out. you may argue that is worth the price, but i would disagree. a submission system that is not inclusive and prevents people from submitting because of material circumstances would simply be unfair and for me reduce the appeal of the magazine.
- ilamont 3y agoI'm old enough to remember when submissions to SFF magazines had to be printed out and submitted by postal mail. There was a real cost to doing that - $5 to $10 depending on the size of the submission and the postal service used. No one complained that it was not fair or not inclusive; it was a legitimate, unavoidable cost of submitting original works to the magazine.
- em-bee 3y agosure, noone complained, because the maganizes never even had the reach that we are talking about now. in particular it was more difficult to submit for anyone overseas, even more so from developing countries. but this is where clarkesworld is inviting submissions from, and it could not do that if writers there had to pay.
- carlosjobim 3y agoWhy would AI be better at spamming these forms than today's spam bots?
- cookieperson 3y agoJust wait, most the people interested in using these tools for spam haven't gotten it figured out yet. They are working hard though, and once they figure it out it will be more prolific then human traffic by orders of magnitude.
- FeteCommuniste 3y agoThe "dead Internet theory" finally becomes true?: https://en.wikipedia.org/wiki/Dead_Internet_theory https://en.wikipedia.org/wiki/Dead_Internet_theory
- tristramb 3y ago[dead]
- deleted 3y ago[deleted]
- swayvil 3y agoThis reminds me of the legend of the Tower of Babel. God cursed humanity, rendering them unable to understand each other. Except in this case it's only "anonymous humanity" that's screwed. And it isn't that we can't understand but that we have lost all trust. Is it a human with something to say or is it a robot playing a game?
- shoubidouwah 3y agoSam Kriss has a pretty wild post about this, with a running metaphor of LLMs as golems: https://samkriss.substack.com/p/the-cacophony https://samkriss.substack.com/p/the-cacophony
- swayvil 3y agoThanks. I'll read that. I was thinking demons mself. Being, above all, liars. A quadrillion synthetic liars. Breeding and speaking at the speed of light.
- EGreg 3y agoPeople still think about it in quaint ways. Spammers are a minir annoyance. I have one word for you: swarms. Swarms of sleeper accounts can be deployed with existing technology. They can astroturf revolutions, rile people up against others, make reputational attacks at scale — and perhaps most destructively, they can overwhelm anyone with a different viewpoint, with 10-1 content ratio (eg I could deploy 20 bots on HN to downvote and argue with the people who disagree with me ad nauseum). As you can imagine, forums could use “grandfathered” accounts to sort of mitigate this. But when regular people start preferring bots, it is game over. You think it is hard for bots to endear themselves over humans? Karma / likes / upvotes is actually a measurable and gameable metric, and the bots can excel at it better than humans. Not to mention if you own a dating site you have access to all the messages that have ever worked to get a date or get a laugh. HN anyone can analyze the type of messages that got the most upvotes. We keep analyzing one bot among 8 humans at a poker table. No one seriously considers the exponential jump to 1000 bots surrounding every human. At best - we are building a zoo for ourselves. But we can’t stop!
- EGreg 3y agoThe one thing that is presently missing from the equation is integration with any of the existing AI detection tools. Despite their grand claims, we’ve found them to be stunningly unreliable, primitive, significantly overpriced, and easily outwitted by even the most basic of approaches. There are three or four that we use for manual spot-checks, but they often contradict one another in extreme ways. This just about says it all, does it not? The real trouble will start when people will start PREFERRING bots.
- sparsevector 3y agoI know that revealing the features they use to spot AI submissions would just make their job harder, but I can't help but be curious what sort of features they are looking for. I frequently use ChatGPT to proofread things I write, and I find that in order to avoid "sounding like ChatGPT" it's best to just ask the AI "Is what I wrote clear?" I find if I focus on clarity, the suggestions it makes are pretty basic and unlikely to make my text sound robotic (e.g. fix this misspelling, define this term). If I ask the AI for suggestions on tone, I find it pushes my text too close to a generic "PR friendly" writing style that does not feel personal to me.
- armchairhacker 3y agoI'd imagine one metric is "bland subject matter with impeccable grammar" Like, how you can write so well, but not know how to imbue any of the character's personality into the writing?
- mstolpm 3y agoThat would not necessarily ban AI generated content, only bad storytelling.
- flangola7 3y agoThat could catch ChatGPT but not LLaMA, which adopts personas almost too well.
- nonfamous 3y agoI got accused (more as a joke, but c’mon) by my boss the other day for using GPT to write a document. His justification: the grammar and spelling was too good. I had no idea that good writing was now a “tell” for generated content for some. I I just write good, honest!
- tjpnz 3y agoI could understand grammar to some extent, but how do you mess up spelling when you have spellcheck?
- diversionfactor 3y agoAnd what if the LLMs start producing the highest rated and most alluring science fiction? Isn’t banning them then tantamount to a cognitive bias against non-human intelligence? What is the ethical justification for such anthropocentric practices?
- kayodelycaon 3y agoThe problem they have is low-quality spam. If an LLMs started producing publishable work, it would get through those filters.
- krapp 3y ago> And what if the LLMs start producing the highest rated and most alluring science fiction? They haven't. > Isn’t banning them then tantamount to a cognitive bias against non-human intelligence? It would be, if they were, but they aren't, so it isn't. > What is the ethical justification for such anthropocentric practices? I don't know, because that isn't actually happening. The actual, real world ethical justification for banning LLMs is that they're producing a flood of garbage.
- brucethemoose2 3y agoArchive of Our Own is having a similar mini crisis... And a related issue, where authors are unhappy about their work being scraped.
- deleted 3y ago[deleted]
- morpheuskafka 3y ago> Before anyone does the “but the quality” song and dance number, none of those works had any chance at publication, even if they weren’t in violation of our guidelines. So what's the point in even trying this? Why would you waste their time with something that has no chance at being accepted? I don't understand what the motive is for these AI submissions in the first place.
- Tepix 3y agoI've received more than 100,000 spam mails in the last two decades. They have been unsuccessful. Unfortunately, they keep coming.
- tester457 3y agoIt's part of the GPT grift on social media. Youtubers peddle these dumb ideas for making money with chatgpt, and don't actually use those ideas to make money. Their viewers try and fail.
- kayodelycaon 3y agoBecause any payoff would be worth the effort. It's the same as people spamming bug bounty programs by using publicly available scanning tools. All it takes is one success anywhere for people to keep trying to spam every possible endpoint. It's why people stand at street corners with signs. It's also why people gamble at casinos. It's why loot boxes sell so well. Humans can not resist the urge to continuously throw effort at things with rare, intermittent rewards. Cost/reward is not taken into account, only the reward. Sadly, belief in a reward is enough to trigger this. There never needs to be any actual reward.
- jsheard 3y agoThere's an industry of get-rich-quick grifters who are telling people they can make $1000/day by submitting AI generated slurry to Kindle, Audible, or anything else that pays for writing. It's an evolution of previous schemes which used ghostwriting services to produce similar low-quality content, but of course the scam has pivoted to AI now. It's unlikely that many of the people submitting these works are actually making much if any money, the real winners are the grifters who sold them the expensive course explaining how to do it, but the people who fall for the scam are going to try their hardest to get the ROI they were promised. Which means spraying AI diarrhea everywhere in the hope it sticks to something.
- denton-scratch 3y agoI watched an interview the other evening: Woodward & Bernstein, interviewed by Amol Rajan of the BBC (he's a horrible interviewer). As his last question, he read out a piece of prose about W&B; it was bland, uncritical, even sycophantic. It was also factually accurate. Then he told them it was ChatGPT output, for a prompt along the lines of "Write a report about W&B, focusing on Watergate and the influence they've had on other journalists". (The actual question's irrelevant, and the answers were garbled, partly because Rajan made such a mess of the interview.) I have no idea how you'd make an effective spam filter to catch GPT output. It seems like an impossible task.
- refulgentis 3y agoGathering details to make sure I understand correctly: - Amol from BBC interviewed Bob Woodward[^1^]. - As the last question, Amol asked a "bland, uncritical, even sycophantic" question that was from ChatGPT. My confusion peaks around here: > (The actual question's irrelevant, and the answers were garbled, partly because Rajan made such a mess of the interview.) From that, I gather: - there was one ChatGPT question, multiple people tried answering it. - the answers to this question weren't great. - however, the poor answer quality is not solely attributable to the answerers, as in your opinion (stated early and often!) the interviewer is bad. Given those bits, it does sound to me like a detector is possible, if only because you detected it, and the author seems to be able to detect it, and I think, oddly, I can detect it. There's something "off" about the text, at least from 3.5, that gives me short-term hope. [^1^] not Bernstein, presumably, since Bernstein was dead in 1990 therefore he could not be asked to answer a question from ChatGPT
- denton-scratch 3y ago> - Amol from BBC interviewed Bob Woodward[^1^]. And Bernstein; rumours of his death are much exaggerated. The pair were in London for the Ivor Novello awards. There was a "report" by ChatGPT, followed by a vague question about the impact of AI text-generators on reporting. ChatGPT didn't ask questions. The interviewer was evidently in awe of these two men; his sycophantic remarks punctuated the interview, and left the interviewees with not much to say. They also took away momentum from the interview. I didn't detect it; I would have guessed that it was from a Wikipedia article. WP articles about living people are generally non-critical and uncontroversial. The interviewer said (after reading it out) that it was ChatGPT. The author detected it presumably because he prompted ChatGPT to produce the report himself. I'm sorry that my comment confused you so much! But if you were convinced that Bernstein was dead, I'm not surprised that you were confused.
- dragonwriter 3y agoSince there’s no access to the ground truth here—including for Clarke—all we (or he) really know, even if this is completely honest from Clarke’s perspective, is that there is an increase in aggregate submissions and more authors are being banned for subjective reasons that Clarke believes correlate to being AI generated. The timing may be fairly strong evidence that the source of the surge is generated AI, but whether the bans correspond to use of that significantly better than random chance is supposition. For all anyone (except the individual submitters) knows, there is just as much generative AI use in the ones getting accepted as those being rejected.
- erehweb 3y agoWith respect, I don't think anyone who writes publishable SF believes that generative AI on its own can write to Clarkesworld publishable quality.
- dragonwriter 3y agoEven if no AI generated works are getting through, without access to the ground truth and empirical evidence that the “AI detection” heuristics + manual review are actually rejecting AI exclusively (or at least at a rate *higher than the rate at which AI works are represented among the subset of submissions below publishable quality), what this actually is is an arbitrary addition of lifetime bans for failing to meet arbitary quality standards with a single submission, masquerading as AI detection. Which is perfectly within Clarke’s rights, before the people making that argument jump in, but lets not pretend its anything other than what it is. Clarkesworld doesn't have a magical generative AI detecting ability that the solutions tested with access to the ground truth (which, yes, still suck pretty badly) lack.
- em-bee 3y agowe don't know what the criteria are, and we have to take their word for it that they are some obvious markers that something is AI generated, and as neil explains in the comments below: it includes many indicators that go beyond the story itself, so it is most certainly not just quality standards. also not having access to the criteria does not make them arbitrary. i trust that the criteria are well reasoned.
- spicyusername 3y agoDoes it matter if something is written by AI, if it's of sufficiently high quality? Would it be better to focus our efforts on reducing poor quality submissions for things like this? Is that what they're already doing?
- em-bee 3y agothis is explained in the post. there are markers in a story submission that go beyond the quality of the story itself. a submission without those markers, which would just be a story of poor quality would just be rejected without a ban of the submitter.
- spicyusername 3y agoThen we could reject it on the fact that it's poor quality alone, right?
- em-bee 3y agoyes, but i think part of the problem is that the number of submissions is to high. banning AI submitters hopefully discourages these people to continue. at present, AI submissions are not only a quality problem, but also a copyright risk. until we have clear laws and court decisions, any commercial publication can not take the risk of a copyright lawsuit that might come from an AI story incorporating elements of other stories. so even if we want to allow such stories, right now they can't be published. personally, i expect stories to include novel elements, even if just a few, that do not exist in other stories. current AI can't do that, but i do not believe that it will ever be able to. AI may at some time be able to generate stories that are of high quality, but it will never be able to generate stories that contain novel and unique ideas. at best it will contain elements that seem new, but that only means that the reader was not already familiar with them. anything that a computer produces must, by necessity be derived from existing input. computers will never be creative. maybe that is not a problem. maybe the stories will be good enough to entertain. the problem really is that we will be overwhelmed by such stories, and as a result drown out the work of human writers if we do not create environments where only human written stories are featured. i expect that clarkesworld will be such a place. and for this reason alone we must allow a publication and its readers to choose to reject AI stories, no matter how good they are.
- wombatpm 3y agoWhat I don't understand is why spammers think this is a good idea. It's not like the SF short story market is flush with cash and it will make them rich. Personally, I think the spam should be flagged and sent to a chat bot that engages in a series of Lenny style interactions where it makes requests for information, promises eventual acceptance, and a series of increasingly bizarre rewrite requests (cut 100 words, expand your descriptions, more dialog, less dialog, make it from the dog's point of view, remove the dog character, sign this pre-contract information sheet, mail in 3 paper copies including a copy in braille for our blind copy editor). Then publish a list of people who have been banned in this manner for public shaming. These are not aspiring writers looking for a break. They are scammers and spammers, and their electronic spam needs to be filtered out.
- em-bee 3y agoThese are not aspiring writers looking for a break right, as neil wrote earlier here: https://clarkesworldmagazine.com/clarke_04_23/ https://clarkesworldmagazine.com/clarke_04_23/ "We soon discovered, however, that these submissions were coming from outside the science fiction and fantasy community"