7 ms·

I'm sure GPT-3 is impressive and probably a paradigm change, but all this hype has an air of urban legend that somehow irks me. We all know of somebody's friend

• madaxe_again 6y ago
  Go play with https://play.aidungeon.io/ https://play.aidungeon.io/ if you want to get a vague idea of the capabilities - the custom scenario gives you a lot of space to play around and see what it’s capable of.
  • lkramer 6y ago
    It reminded me of those chatbots from the 70s which would give vague replies to your question that at first glance looks relevant to what you're saying, but are actually just generic nonsense.
    • gokhan 6y ago
      Dr. Sbaitso.
      • zzbzq 6y ago
        It reminds me exactly of Dr. Sbaitso. The difference is, with Sbaitso you noticed after its second reply it was all non-sequitur stuff. With GPT-3 it's more verbose so it takes 3-4 replies that go in different directions to notice its replies were merely vague suggestions because it never really had a point to make.
    • cmrdporcupine 6y ago
      I'm pleased to see that Emacs still ships with "doctor" Eliza mode.
    • segfaultbuserr 6y ago
      I can absolutely guarantee you that this is not one of those chatbots from the 70s. You need to pay a few bucks to unlock the Dragon model, which is based on GPT-3, the default engine is not. Once the new model is selected, start the game with "(6) Custom" mode, and input an arbitrary body of text, then the program will start writing. Although the output is biased for playing text adventure game, but the input is really arbitrary, just throw whatever you have on your hands, and very likely, it's able to give a reasonable output. At least when I tried, AI Dragon was able to write the first chapter of a hypothetical textbook on electronics engineering for me, filled with nonsense but all the technical terms are correct (e.g. common-base amplifier, base-emitter junction, MOSFET, etc), it was even able to write down the rise time to bandwidth formula. On an another attempt, it was able to write a Sci-Fi adventure story similar to Ghost in the Shell with minimum human guidance, 95% of the output is automatically generated. And none of the output was a copy from a known source, it was all original without human assistance.
      • JetSpiegel 6y ago
        > I can absolutely guarantee you that this is not one of those chatbots from the 70s. If random people on the Internet say so... It's still much worse than Zork, that ran on a Z80. Here's a "cyberpunk story": You are Bobby Tables, a cop living in the the futuristic city of Zail. You have a laser pistol and a stunner. You are part of a police unit tasked with finding government criticizers. You wake up in the morning and hear on the radio that a dissident has been captured. Using public transport, you arrive at Cafe Nervosa, the dissidents favorite hang out, to find it filled with cops. > You break some kneecaps. You try to get the ah-ha moment. You see a man and a woman arguing about the government but you can't make out what they are saying. > You murder black people. You spot a bum sleeping against a wall. You know the He said to charge, but you lov e to negotiate. You try to walk straight up to him, but people move out of your way. > You plant evidence. You go straight to the gateman. "I wan t to plant evidence," you say. He looks at you, puzzled. "You don't want to w ant to plant evidence." "Yes...?" ... > You say "do you feel lucky, punk?" The woman rolls her eyes. "What the hell...?" she says. She pulls a walky talkie out of her pocket and speaks into it. "I need back up, over." A pause. > You say "did I fire 6 shots, or only 5?" She looks at you. "What?
    • travbrack 6y ago
      The free version uses gpt-2. You'll need to pay to use the "Dragon" engine which is gpt-3. Edit: looks like there's a 7-day trial
  • exolymph 6y ago
    You have to pay up for GPT-3, unless something has changed.
    • drabiega 6y ago
      You get GPT-3 either way now, I believe. Dragon, the one locked to subscribers, is GPT-3 XL or something like that? Relevant Developer Tweet: https://twitter.com/nickwalton00/status/1284842455188164609 https://twitter.com/nickwalton00/status/1284842455188164609
      • squeaky-clean 6y ago
        Interesting, in the game settings it still refers to non-dragon as GPT-2. Thought it doesn't specifically say Griffon. It's a little confusing. > Note: on custom prompts, the very first generation is generated with GPT-2 instead of Dragon (but every generation after will use Dragon).
        • drabiega 6y ago
          Ah, that's referring to something else. By generation it means the first output string of every scenario. IIRC I heard someone mention that OpenAI made them do that because people were trying to end-run around the GPT-3 access restrictions?
  • deleted 6y ago
    [deleted]
  • deleted 6y ago
    [deleted]
  • Keyframe 6y ago
    This is not all that good, to be honest. Maybe I’m shit and my inputs are shit as well, but this is a step around ELIZA. It looks like it hooks itself around few nouns or sentence constructs and pattern matches them from whatever it has in its “database” and tries to construct like a kidnapper’s letter - a piece consisting of multiple fragments that make no sense together.
    • Veedrac 6y ago
      Did you sign up for the Dragon model?
      • Keyframe 6y ago
        Custom and fantasy so far. Fantasy was recommended even.
        • squeaky-clean 6y ago
          Those are genre choices for your story. You need to register an account and go to your settings and switch between the default Griffon model and the Dragon model. Both models offer the same choice of genres but with very different text generation quality.
    • squeaky-clean 6y ago
      FYI you need to sign up for the paid service (or use the free trial) and then enable the Dragon Model in the settings, otherwise you get the older "Griffon" model. (edit: I thought Griffon was GPT-2, changed text) However I still mostly agree with you. I've played a few rounds and while the text generation and "memory" is extremely impressive to me as a programmer, there are many errors it makes that a human would not, like a robot bleeding blood when injured. Also this next bit isn't too relevant to Dragon/GPT-3, but it's not really much of a... game. You can say something like "I wait until nightfall and use a grappling hook to climb into the tallest tower of the royal castle. I sneak down the tower into the Kings bedchamber and stab the king while he sleeps." and it just allows you to do all that. It's very impressive that it understands all those details. It will remember that it's nightfall and I'm in the royal castle. It will remember the tallest tower as a means of exit and entry and create other realistic castle set pieces if you explore further. But where is the challenge? I wish it had some sort of mechanical rules, like each statement can only cover 10 seconds of time. If you do try to write only short actions like you would a text adventure game, then it will make decisions you do not want. My first ever playthrough I was a rogue who snuck into a magic shop, I told the game I want to hide behind a door. The game told me I opened the door to see the shopkeeper and then stabbed him with my dagger. I had no intention of murdering any NPCs.
  • fpgaminer 6y ago
    I've poured more hours than I'll admit into AIDungeon at this point. The Dragon model is ridiculously good. I think everybody should try it, even if they're not into text adventures. In fact, it's quite a poor "text adventure". But it's a really fun story telling tool. The hype is worth it in that regard. Having poured that much time into GPT-3 as a storyteller I can relay its weaknesses. The obvious limitation is the limited context (1024 tokens last the dev tweeted). It's really good at playing out isolated "scenes". It constantly surprises me with the creative things it comes up with. But yeah, outside of a scene, it totally loses focus on the bigger picture. We see the same problems with OpenAI's musicbox app, which struggled to be coherent across even a short song. That makes it a poor replacement for a true Dungeon Master, but a really useful tool for writing scenes. There are less publicized limitations. It sometimes gets the subject of sentences confused. When it does, it really wants to stick with that confusion regardless of how many times you have it retry. It often gets confused by who's speaking. Even when I go back and edit she/he said into its responses. AI Dungeon has a mode to turn off quotes presumably for this reason. It seems to have the same failings that image GANs do. Image GANs have "blind spots", types of images that they won't ever generate because they were too hard for it to learn. GPT-3 also has blind spots, certain ideas that it just doesn't understand. It won't generate content based on those ideas, and if it sees those ideas in its context it starts going off the rails. If you're lucky it'll just ignore the idea and generate what I call U-turn responses. That's where it does a 180 degree turn right out of the scene by saying something like "Suddenly there's a knock at the door!" and changing the scene. But half the time it just starts going into a loop and repeating itself. It's not as bad as GPT-2 where the repetition was like "like like like like like like". But it will repeat the same sentences or ideas over and over again. I guess because it doesn't understand the scene anymore it feels like repetition is the safest option. I haven't found any common trope to the ideas/scenes it has trouble with. Maybe it's just stuff it never got exposed to in its training set. I was looking over the GPT-3 paper this week and while the dataset is massive, it's by no means expansive yet. A human story teller is likely to have similar blind spots in terms of ideas we're familiar with, I think we're just far better one-shot learners. All this to say, AI Dungeon (and thus GPT-3) is amazing, in a limited context. If you let it drive the story and give a certain leeway to do crazy stuff, the adventures it will send you on are several orders of magnitude more interesting than I ever thought an AI was capable of in this decade.
  • calmworm 6y ago
    The man “rips you off the drugs” ... I suppose I was “on drugs” so being ripped off them as if it were a physical object would makes sense. No matter what I tried, the story just kept plodding along without taking much of my input into account. How is it supposed to work?