4 ms·

I've noticed similar refusal to auto-generate anything if certain other kinds of words exist in a line. I'm working on adding some AI text generation into an R

I've noticed similar refusal to auto-generate anything if certain other kinds of words exist in a line. I'm working on adding some AI text generation into an RPG, trying to liven up the NPCs a little bit. For flavor text, the model gets fed information about the name, race, class and gender of the character they're playing. I've noticed that Copilot will happily autocomplete lines about the character's name and class. But the words 'race' and 'gender' completely halt the auto-completion mechanism. I have to type the entire line out by hand, copilot won't suggest a thing, even when talking about Elves and Orcs. The next line it goes back to normal. I can't say I'm confused why they did it, though. There's definitely a certain kind of person who would read way too much into whatever hallucinations the model comes up with in those areas.

ender341341 3y ago
It also doesn't help that lots of previous attempts at AI have been gamed by 4chan into spouting super racist rants out without provocation when user content is used as part of the learning model. (see MS tay for a highly visible example)
thelastparadise 3y ago
If you're doing this for a game, I suggest trying a camelid like the alpacino model, vicuna uncucked, or wizard uncensored. You'll get much more interesting and creative results than any OpenAI model. The open models are really outperforming GPT-4 in this area.
- netruk44 3y ago
  I think I might have phrased my original message poorly. I'm not using Copilot/GPT to directly generate the text in the game. Copilot is only helping me to write the code that generates a prompt, which then gets sent off to whatever other model I want. But the suggestions are appreciated, though! I have a framework that allows me to swap out arbitrary model 'back-ends' on the fly. So I can definitely take a look to see if these work well for my case.

ender341341 3y ago

It also doesn't help that lots of previous attempts at AI have been gamed by 4chan into spouting super racist rants out without provocation when user content is used as part of the learning model. (see MS tay for a highly visible example)

thelastparadise 3y ago

If you're doing this for a game, I suggest trying a camelid like the alpacino model, vicuna uncucked, or wizard uncensored. You'll get much more interesting and creative results than any OpenAI model. The open models are really outperforming GPT-4 in this area.

netruk44 3y ago
I think I might have phrased my original message poorly. I'm not using Copilot/GPT to directly generate the text in the game. Copilot is only helping me to write the code that generates a prompt, which then gets sent off to whatever other model I want. But the suggestions are appreciated, though! I have a framework that allows me to swap out arbitrary model 'back-ends' on the fly. So I can definitely take a look to see if these work well for my case.