4 ms·

I would start with a rogue-like game and the hard part becomes generating the training data to describe in beautifully flowing prose what happens on a per move

I would start with a rogue-like game and the hard part becomes generating the training data to describe in beautifully flowing prose what happens on a per move basis. Enter your patient friend who offers to do this and has run lots of campaigns previously. It seems like something that could be trained starting with an existing GPT model and specialized to this task to me, but I'm just brain farting here. And by all means steal this idea if you're so inclined.

heyitsguay 5y ago
It seems like the hardest part isn't world model -> prose (still hard tbc), but prose -> world model. There have been games for a long time that let you interact with a world model via simple verb + object statements (e.g. "get key", "search chest"), but the power of GPT3-style AI dungeons isn't just that it handles longer, more natural text input, it's that there are no restrictions on the (short-term, incoherent) world model they use to generate responses. If you want to "throw key at the biggest goblin", you'll get a response that's coherent (in the short term) instead of an error saying that you can't do that with keys. When you pair a better, prosier text input-response system with a procedural world model, if the procedural world model is built like existing ones you'll still have to deal with restrictions in the world's content and the valid interactions between constituents. At which point all that fancy AI makes for a more natural parser but doesn't add any richness to the game world, which is the thing we'd like to get at. If anyone has ideas for how to solve the prose -> world model problem, that could be super fun and rewarding to work on, probably so much so that they wouldn't be sharing them here :(
- proser 5y ago
  There's a really interesting cross-over here with literary structure. You need to teach a model to recognize tone, theme, and setting in addition to world "facts." What makes a world like Westeros different than the Shire isn't just facts like "seasons are really long" but elements of tension, political unrest, and the outlook of the people who inhabit it. To do this effectively, you need to be building simulations of literary works. There's always going to be an art to this, but instead of the manuscript, it's going to be about the parts of the model.
  - heyitsguay 5y ago
    I think in the context of natural language for game worlds, "prose" is targeting the much lower bar of something that sounds like a human might write it, vs like "you PLACED KEY in THE LEFT DOOR. Proceed to A STAIRCASE" from games of yore. Understanding the much richer space of literary prose, such as the difference between the Shire and Westeros, seems like a harder problem, but also one that might be well suited for existing NLP training pipelines, because you can label a large amount of text with only a few descriptors. It might be tough to come to a consensus amongst literary experts what those descriptors should be, but e.g. if LOTR book 1 is "pastoral" and ASOIAF book 1 is "gritty", you've now got a lot of text associated to each of those labels. I wonder if anyone is working on this?
    - varelse 5y ago
      SHRDLU was a simple world you could manipulate with English prose back in the 1960s. https://en.wikipedia.org/wiki/SHRDLU https://en.wikipedia.org/wiki/SHRDLU Unless you feel you need flowery expressive input as well as output. But do we really need input more sophisticated than that of Zork here?

heyitsguay 5y ago

It seems like the hardest part isn't world model -> prose (still hard tbc), but prose -> world model. There have been games for a long time that let you interact with a world model via simple verb + object statements (e.g. "get key", "search chest"), but the power of GPT3-style AI dungeons isn't just that it handles longer, more natural text input, it's that there are no restrictions on the (short-term, incoherent) world model they use to generate responses. If you want to "throw key at the biggest goblin", you'll get a response that's coherent (in the short term) instead of an error saying that you can't do that with keys. When you pair a better, prosier text input-response system with a procedural world model, if the procedural world model is built like existing ones you'll still have to deal with restrictions in the world's content and the valid interactions between constituents. At which point all that fancy AI makes for a more natural parser but doesn't add any richness to the game world, which is the thing we'd like to get at. If anyone has ideas for how to solve the prose -> world model problem, that could be super fun and rewarding to work on, probably so much so that they wouldn't be sharing them here :(

proser 5y ago
There's a really interesting cross-over here with literary structure. You need to teach a model to recognize tone, theme, and setting in addition to world "facts." What makes a world like Westeros different than the Shire isn't just facts like "seasons are really long" but elements of tension, political unrest, and the outlook of the people who inhabit it. To do this effectively, you need to be building simulations of literary works. There's always going to be an art to this, but instead of the manuscript, it's going to be about the parts of the model.
- heyitsguay 5y ago
  I think in the context of natural language for game worlds, "prose" is targeting the much lower bar of something that sounds like a human might write it, vs like "you PLACED KEY in THE LEFT DOOR. Proceed to A STAIRCASE" from games of yore. Understanding the much richer space of literary prose, such as the difference between the Shire and Westeros, seems like a harder problem, but also one that might be well suited for existing NLP training pipelines, because you can label a large amount of text with only a few descriptors. It might be tough to come to a consensus amongst literary experts what those descriptors should be, but e.g. if LOTR book 1 is "pastoral" and ASOIAF book 1 is "gritty", you've now got a lot of text associated to each of those labels. I wonder if anyone is working on this?
  - varelse 5y ago
    SHRDLU was a simple world you could manipulate with English prose back in the 1960s. https://en.wikipedia.org/wiki/SHRDLU https://en.wikipedia.org/wiki/SHRDLU Unless you feel you need flowery expressive input as well as output. But do we really need input more sophisticated than that of Zork here?