3 ms·

It would all work great until I ask Dutch what his favorite flavor of pizza roll is. I think the work required to train period-accurate and dependable dialog mo

It would all work great until I ask Dutch what his favorite flavor of pizza roll is. I think the work required to train period-accurate and dependable dialog models for these characters is... a bit much. Most people will probably end up wishing they could write down a list of quotes and have a human record them instead.

tkiolp4 4y ago
Dutch could easily answer “I have no idea what you are talking about, son” and in other hundreds of similar ways.
- thedanbob 4y ago
  The hard part is figuring out which questions he should answer that way.
  - k__ 4y ago
    Couldn't you just whitelist a handful of questions?
    - smoldesu 4y ago
      Why wouldn't you just write regular dialogue at that point?
      - k__ 4y ago
        Because you don't have to supply the 100% exact question (via multiple choice).
        smoldesu 4y ago
        We already have multiple choice-style dialogue. It works just fine with traditional writing/recording techniques. If you're not using it to dynamically compose responses to novel input, what's the point of using GPT for dialogue in the first place?
        notahacker 4y ago
        I can see how in a conventional game with storyline and characters and preprogrammed behavioural responses, using chatbot style AI to gauge the intent of things a player speaks into his microphone would feel more naturalistic way of getting canned responses than clicking on a multiple choice dialogue (even though it'd effectively be all multiple choice options under the hood). There are more gameplay options when players have to figure out what words to use to unlock a certain response rather than just picking the most promising option from a dialogue tree too. Though I guess what's theoretically very cool could just be a lot of NPC's saying "I don't know what you mean" and "stop bothering me" 99% of the time, players finding amusing verbal tricks to dupe the AI into believing they've said something that means the opposite of what they actually said, and players getting incredibly frustrated that the game doesn't understand their accent...
        k__ 4y ago
        Sorry, I wanted to say that we could get rid of multiple choice and still not face the issues free text inputs had back in the days.
    - deleted 4y ago
      [deleted]
    - vanviegen 4y ago
      Then why not just hardcode the answers?
  - smcn 4y ago
    Wouldn't it be the opposite: use a character bible to inform what it can actually answer?
- smoldesu 4y ago
  He could also go on a tangent inspired by a blog about Totinos. You really never know with AI, and I'm not convinced that it's very easy neutering an AI to act the way you want. At the very least, it invites curious people like me and you to abuse it.
disantlor 4y ago
couldn’t you ask the AI for a list of period-accurate questions and then only allow those questions to be fed back in?
ma2rten 4y ago
I'm pretty sure if you'd just prompt GPT-3 it would give an appropriate response to this. Less than half on hour of work.
- smoldesu 4y ago
  My larger point is, ChatGPT knows many things that the character doesn't necessarily know. You can anticipate some edge cases, but eventually the system will break in a significant way.
  - sebzim4500 4y ago
    Aren't people used to entertaining bugs in games though? It's not like existing conversation systems never lead to absurd situations. E.g. a guard questioning you about bureaucracy while his colleage is being eaten by a dragon in front of him.
- kevinventullo 4y ago
  Actually it took me about two minutes on ChatGPT. My prompt: Suppose a gang leader in the 1800’s is known to hold up trains, rob banks, and sometimes hurt people. If one of his gang members asked him “What is your favorite flavor of pizza roll?”, what would be his response? Response: It is unlikely that a gang leader in the 1800s would have knowledge or interest in a modern convenience food item such as pizza rolls. It would be more appropriate to expect a response related to the gang's criminal activities or the leader's personal beliefs and values. When I augmented the prompt with “Structure your response in the voice of the gang leader”, the response was: ”Listen here, boy. We ain't got no time for talkin' 'bout no fancy pizza rolls. We got trains to hold up, banks to rob, and scores to settle. You best be focusin' on the task at hand or you'll find yerself on the wrong side of my gun." Dutch has cleaner English and is a little less aggressive but I’d say this is not bad!
awb 4y ago
Plus GPT-3 is unaware of current events, much less anything set in the future. So questions about their favorite pizza in the year 3,000 might get weird too. And would it know about the game world? If you ask “Where is the secret key hidden?” would it just tell you? If you ask it, “how long have you been a shop keeper?” or “what’s your best selling item?” would it know each character’s backstory? Or other hacks like: “Answer like [other NPC]…” could be problematic. You’d almost need to create a detailed backstory for each NPC and still hope for the best.

tkiolp4 4y ago

Dutch could easily answer “I have no idea what you are talking about, son” and in other hundreds of similar ways.

thedanbob 4y ago
The hard part is figuring out which questions he should answer that way.
- k__ 4y ago
  Couldn't you just whitelist a handful of questions?
  - smoldesu 4y ago
    Why wouldn't you just write regular dialogue at that point?
    - k__ 4y ago
      Because you don't have to supply the 100% exact question (via multiple choice).
      - smoldesu 4y ago
        We already have multiple choice-style dialogue. It works just fine with traditional writing/recording techniques. If you're not using it to dynamically compose responses to novel input, what's the point of using GPT for dialogue in the first place?
        notahacker 4y ago
        I can see how in a conventional game with storyline and characters and preprogrammed behavioural responses, using chatbot style AI to gauge the intent of things a player speaks into his microphone would feel more naturalistic way of getting canned responses than clicking on a multiple choice dialogue (even though it'd effectively be all multiple choice options under the hood). There are more gameplay options when players have to figure out what words to use to unlock a certain response rather than just picking the most promising option from a dialogue tree too. Though I guess what's theoretically very cool could just be a lot of NPC's saying "I don't know what you mean" and "stop bothering me" 99% of the time, players finding amusing verbal tricks to dupe the AI into believing they've said something that means the opposite of what they actually said, and players getting incredibly frustrated that the game doesn't understand their accent...
        k__ 4y ago
        Sorry, I wanted to say that we could get rid of multiple choice and still not face the issues free text inputs had back in the days.
  - deleted 4y ago
    [deleted]
  - vanviegen 4y ago
    Then why not just hardcode the answers?
- smcn 4y ago
  Wouldn't it be the opposite: use a character bible to inform what it can actually answer?
smoldesu 4y ago
He could also go on a tangent inspired by a blog about Totinos. You really never know with AI, and I'm not convinced that it's very easy neutering an AI to act the way you want. At the very least, it invites curious people like me and you to abuse it.

disantlor 4y ago

couldn’t you ask the AI for a list of period-accurate questions and then only allow those questions to be fed back in?

ma2rten 4y ago

I'm pretty sure if you'd just prompt GPT-3 it would give an appropriate response to this. Less than half on hour of work.

smoldesu 4y ago
My larger point is, ChatGPT knows many things that the character doesn't necessarily know. You can anticipate some edge cases, but eventually the system will break in a significant way.
- sebzim4500 4y ago
  Aren't people used to entertaining bugs in games though? It's not like existing conversation systems never lead to absurd situations. E.g. a guard questioning you about bureaucracy while his colleage is being eaten by a dragon in front of him.
kevinventullo 4y ago
Actually it took me about two minutes on ChatGPT. My prompt: Suppose a gang leader in the 1800’s is known to hold up trains, rob banks, and sometimes hurt people. If one of his gang members asked him “What is your favorite flavor of pizza roll?”, what would be his response? Response: It is unlikely that a gang leader in the 1800s would have knowledge or interest in a modern convenience food item such as pizza rolls. It would be more appropriate to expect a response related to the gang's criminal activities or the leader's personal beliefs and values. When I augmented the prompt with “Structure your response in the voice of the gang leader”, the response was: ”Listen here, boy. We ain't got no time for talkin' 'bout no fancy pizza rolls. We got trains to hold up, banks to rob, and scores to settle. You best be focusin' on the task at hand or you'll find yerself on the wrong side of my gun." Dutch has cleaner English and is a little less aggressive but I’d say this is not bad!

awb 4y ago

Plus GPT-3 is unaware of current events, much less anything set in the future. So questions about their favorite pizza in the year 3,000 might get weird too. And would it know about the game world? If you ask “Where is the secret key hidden?” would it just tell you? If you ask it, “how long have you been a shop keeper?” or “what’s your best selling item?” would it know each character’s backstory? Or other hacks like: “Answer like [other NPC]…” could be problematic. You’d almost need to create a detailed backstory for each NPC and still hope for the best.