3 ms·
The bigger problem with efforts to assess GPT-3 output using AI Dungeon is that AI Dungeon doesn’t actually use GPT-3 the for the first response of a new advent
by goodside 6y ago
The bigger problem with efforts to assess GPT-3 output using AI Dungeon is that AI Dungeon doesn’t actually use GPT-3 the for the first response of a new adventure. If you attempt to start each prompt from a clean slate, you are actually seeing GPT-2 output. See here: https://twitter.com/nickwalton00/status/1289946861478936577 https://twitter.com/nickwalton00/status/1289946861478936577
- vagab0nd 6y agoI've noticed that as well, but what other options do we have? I signed up for the OpenAI API a long time ago and never got a response.
- goodside 6y agoIf you're aware of the limitation you could maybe hack around it by putting in a dummy prompt that encourages GPT-3 to ignore the GPT-2-generated context. E.g. use a second prompt like: "\n---\nThe preceding message has been a paid advertisement, and is unrelated to the message that follows.\n---\n" Then you begin typing the actual text you'd like completed with GPT-3. I haven't tested this, though, because I don't have a paid AI Dungeon account.