4 ms·

wrt "(Although I'm not sure how much human guidance it has)" - at the top it says "Text Formatting: Human-written text is italic, AI-generated text is normal"

wrt "(Although I'm not sure how much human guidance it has)" - at the top it says "Text Formatting: Human-written text is italic, AI-generated text is normal" so that kind of demonstrates the ratio [and the human selects the AI completions among a few options each time] And yeah, generally agree - as we say on our About page, these stories are sort of explorations/demonstrations of what AI can do, as much as they are attempts at entertaining writing. So in a sense we want to keep the "weird choices" AI makes to let the story go in weird directions. Since we release weekly, the intent is in general not to go for a lot of polish but rather for a fun concept and just an entertaining read.

jrochkind1 4y ago
Fair. But i'm not talking as much about the story "going in weird directions", as I am about the way the sentences and paragraphs are constructed. Or apparent contradictions like "We found that planets with life on them were rare" followed by "But life did develop on one planet" -- so is that "rare" or just one? "which evolved one of the most diverse biospheres we had ever seen" -- wait, so how many "biospheres" (implying life) have you seen, again? "one of the most... we've seen" is a weird thing to say if you've seen only one, or even only a few! It's just like, wait, what are you trying to tell me here, what parts of these sentances serve the story? Is the feedback I'd give if this were a writing workshop, I'm not talking about the way the plot developed, I'm talking about the way the words are constructed into sentances and sentances into paragraphs. It just seems... sloppy, like someone wasn't trying very hard just kind of throwing words on a page without thinking very much and not editing. But it is all understandable more-or-less grammatical English which is a coherent (if poorly-written) narrative, so, sure, that's a thing.
- andreyk 4y ago
  To your last paragraph, yeah that's kind of the case. We want to use the AI generated as-is more or less to showcase what it produces, so editing those sentences you mention to be more consistent with each other would mess with that. Plus, trying to finish a short story once per week while working a full time job (we currently have one main author on the team) kind of necessitates rushing things and not polishing that much. So the intent is not to write a particularly well-written narrative so much as a fun/entertaining read that showcases what the AI can bring to writing today (even if it's flawed, as you say). Perhaps we'll aim for more polished writing or more human editing in the future, we are still figuring things out as we go!
  - jrochkind1 4y ago
    I am not critisizing you, I am giving my own review of what the AI you are using has or hasn't accomplished in this case! I agree that you manually editing to be better written wouldn't have much purpose. I think the point of this exersize is probably "See what an AI can accomplish?" I was reviewing that.
    - andreyk 4y ago
      ah I see, I did not get that it seems. Cool, yeah I think your analysis of the AI's output is quite solid.
  - GalahiSimtam 4y ago
    Well this reminds me of the priming that is in AI Test Kitchen https://aitestkitchen.withgoogle.com/how-lamda-works https://aitestkitchen.withgoogle.com/how-lamda-works I mean, the example with "I'm at a planet made of marshmallows" and how the generated text changes from the default I guess style to a bombastic description. I don't have an example of that in GPT-3 playground right away, but I suppose it works similarly and could be used to nudge the AI writing style in some way. This is also why I'm not holding any expectations with offering you a story idea; the AI can come up with a story idea, in my experience, once I did not start with "You wake up in a cart in Skyrim" but with mere "You wake up in a carriage" and the AI started to improv right away, "A man in black robe enters the carriage", and I let it continue, chiefly on its own. Though I haven't saved that story, I will remember it well - the mysterious man in black robe locked up the protagonist with a book containing every knowledge of the universe, telling that after a year he'll come back to ask questions; and he came back after a year and asked Deep Philosophical Questions (TM), and the protagonist had not to shabby answers to them; among them stoically accepted death. Subsequently, the mysterious man took the book and left, leaving the room no longer locked. The protagonist traveled to the nearest village and settled to a work as a teacher. Fast forward twenty years later, meeting the black robed figure again, this time it was revealed to be Azrael (the angel of death); only then the protagonist felt truly the fear of death and that changed at least one of the answers to the Deep Philosophical Questions (TM) from the earlier part of the story. Feel free to use that as a prompt; I doubt the AI will recreate that story with a good writing style with just that, but AI are capricious and one never knows until tries.

jrochkind1 4y ago

Fair. But i'm not talking as much about the story "going in weird directions", as I am about the way the sentences and paragraphs are constructed. Or apparent contradictions like "We found that planets with life on them were rare" followed by "But life did develop on one planet" -- so is that "rare" or just one? "which evolved one of the most diverse biospheres we had ever seen" -- wait, so how many "biospheres" (implying life) have you seen, again? "one of the most... we've seen" is a weird thing to say if you've seen only one, or even only a few! It's just like, wait, what are you trying to tell me here, what parts of these sentances serve the story? Is the feedback I'd give if this were a writing workshop, I'm not talking about the way the plot developed, I'm talking about the way the words are constructed into sentances and sentances into paragraphs. It just seems... sloppy, like someone wasn't trying very hard just kind of throwing words on a page without thinking very much and not editing. But it is all understandable more-or-less grammatical English which is a coherent (if poorly-written) narrative, so, sure, that's a thing.

andreyk 4y ago
To your last paragraph, yeah that's kind of the case. We want to use the AI generated as-is more or less to showcase what it produces, so editing those sentences you mention to be more consistent with each other would mess with that. Plus, trying to finish a short story once per week while working a full time job (we currently have one main author on the team) kind of necessitates rushing things and not polishing that much. So the intent is not to write a particularly well-written narrative so much as a fun/entertaining read that showcases what the AI can bring to writing today (even if it's flawed, as you say). Perhaps we'll aim for more polished writing or more human editing in the future, we are still figuring things out as we go!
- jrochkind1 4y ago
  I am not critisizing you, I am giving my own review of what the AI you are using has or hasn't accomplished in this case! I agree that you manually editing to be better written wouldn't have much purpose. I think the point of this exersize is probably "See what an AI can accomplish?" I was reviewing that.
  - andreyk 4y ago
    ah I see, I did not get that it seems. Cool, yeah I think your analysis of the AI's output is quite solid.
- GalahiSimtam 4y ago
  Well this reminds me of the priming that is in AI Test Kitchen https://aitestkitchen.withgoogle.com/how-lamda-works https://aitestkitchen.withgoogle.com/how-lamda-works I mean, the example with "I'm at a planet made of marshmallows" and how the generated text changes from the default I guess style to a bombastic description. I don't have an example of that in GPT-3 playground right away, but I suppose it works similarly and could be used to nudge the AI writing style in some way. This is also why I'm not holding any expectations with offering you a story idea; the AI can come up with a story idea, in my experience, once I did not start with "You wake up in a cart in Skyrim" but with mere "You wake up in a carriage" and the AI started to improv right away, "A man in black robe enters the carriage", and I let it continue, chiefly on its own. Though I haven't saved that story, I will remember it well - the mysterious man in black robe locked up the protagonist with a book containing every knowledge of the universe, telling that after a year he'll come back to ask questions; and he came back after a year and asked Deep Philosophical Questions (TM), and the protagonist had not to shabby answers to them; among them stoically accepted death. Subsequently, the mysterious man took the book and left, leaving the room no longer locked. The protagonist traveled to the nearest village and settled to a work as a teacher. Fast forward twenty years later, meeting the black robed figure again, this time it was revealed to be Azrael (the angel of death); only then the protagonist felt truly the fear of death and that changed at least one of the answers to the Deep Philosophical Questions (TM) from the earlier part of the story. Feel free to use that as a prompt; I doubt the AI will recreate that story with a good writing style with just that, but AI are capricious and one never knows until tries.