5 ms·

I can't wait for the day we see "deep-dream" styled literary works.

by gzu 7y ago

jandrese 7y ago
There have been plenty of "AI written" textual works, like the AI Dungeon for a D&D game, or the AI Recipe Generator that attempts to make something that looks like a cooking recipe. For the most part they aren't successful because the "AI" isn't smart enough to have a goal in mind, so they end up just monkey-cheesing everything. Pasting together snippets in ways that are usually grammatically correct but make no sense.
- okigan 7y ago
  any books/papers that address "goal" oriented NLP or hybrid based discussion?
  - jandrese 7y ago
    The ability to set your own goals and task yourself to achieve them is the essence of AI. Not "AI" as we know it today, but Sci-fi AI where it's a machine person.
    - joe_the_user 7y ago
      Indeed, but that kind of describes the gulf between current language processing and present AI. Present AI generates tokens that seem to have meaning or seem like an appropriate response to a statement but where it become evident after 2-3 paragraphs, there's no substantial relation to either underlying meaning or underlying goals. Part of this is "underlying meaning" is an intuitive way to describe things but whatever is underlying here is more tenuous than a classical logic/GOFAI model of the world but more "solid" than a long, clever stream of associations.
    - sgt101 7y ago
      Is it? It's pretty clear that this kind of activity isn't that common in humans - mostly we pick up our goals from cues and drivers in our environment and society.
    - okigan 7y ago
      If one interprets that "set you own goals" is the task of AI then it's probably Sci-Fi AI, but that wasn't my question. Let's say we have a goal, "evaluate persons impression of a particular book/topic/etc". So the goal would be to have a conversation on this and related topics that would (re)construct person's impression. Hence my question if there are any publications/articles that explored that?
  - ctoth 7y ago
    There's interesting research out of Deepmind on two parts of this, which are using the Transformer model in Reinforcement Learning contexts[0] and creating textual GANs[1]. As you are probably aware, GANs are one of the important tools that have driven forward image synthesis and until recently it was impossible to apply them to text, so I expect this to push us quite a bit forward. There's also ongoing work in the selection of the metric to use to evaluate the generated text, and discriminate between human and machine-generated text. [0] https://arxiv.org/abs/1910.06764 https://arxiv.org/abs/1910.06764 [1] https://arxiv.org/abs/1905.09922 https://arxiv.org/abs/1905.09922
- mpoteat 7y ago
  GPT2 does have a goal in mind, namely an idea akin to "minimal surprise". The problem is that it doesn't have a model of the world its talking about, so it quickly says things that are locally sensible but globally inconsistent.
SQueeeeeL 7y ago
But what would be the point... after the novelty wears off, no one considers deep dream anything other than an outcome of the system, not as art with an intended meaning (unless the point of art without meaning)

I can't wait for the day we see "deep-dream" styled literary works.

by gzu 7y ago

I can't wait for the day we see "deep-dream" styled literary works.

There have been plenty of "AI written" textual works, like the AI Dungeon for a D&D game, or the AI Recipe Generator that attempts to make something that looks like a cooking recipe. For the most part they aren't successful because the "AI" isn't smart enough to have a goal in mind, so they end up just monkey-cheesing everything. Pasting together snippets in ways that are usually grammatically correct but make no sense.

okigan 7y ago
any books/papers that address "goal" oriented NLP or hybrid based discussion?
- jandrese 7y ago
  The ability to set your own goals and task yourself to achieve them is the essence of AI. Not "AI" as we know it today, but Sci-fi AI where it's a machine person.
  - joe_the_user 7y ago
    Indeed, but that kind of describes the gulf between current language processing and present AI. Present AI generates tokens that seem to have meaning or seem like an appropriate response to a statement but where it become evident after 2-3 paragraphs, there's no substantial relation to either underlying meaning or underlying goals. Part of this is "underlying meaning" is an intuitive way to describe things but whatever is underlying here is more tenuous than a classical logic/GOFAI model of the world but more "solid" than a long, clever stream of associations.
  - sgt101 7y ago
    Is it? It's pretty clear that this kind of activity isn't that common in humans - mostly we pick up our goals from cues and drivers in our environment and society.
  - okigan 7y ago
    If one interprets that "set you own goals" is the task of AI then it's probably Sci-Fi AI, but that wasn't my question. Let's say we have a goal, "evaluate persons impression of a particular book/topic/etc". So the goal would be to have a conversation on this and related topics that would (re)construct person's impression. Hence my question if there are any publications/articles that explored that?
- ctoth 7y ago
  There's interesting research out of Deepmind on two parts of this, which are using the Transformer model in Reinforcement Learning contexts[0] and creating textual GANs[1]. As you are probably aware, GANs are one of the important tools that have driven forward image synthesis and until recently it was impossible to apply them to text, so I expect this to push us quite a bit forward. There's also ongoing work in the selection of the metric to use to evaluate the generated text, and discriminate between human and machine-generated text. [0] https://arxiv.org/abs/1910.06764 https://arxiv.org/abs/1910.06764 [1] https://arxiv.org/abs/1905.09922 https://arxiv.org/abs/1905.09922
mpoteat 7y ago
GPT2 does have a goal in mind, namely an idea akin to "minimal surprise". The problem is that it doesn't have a model of the world its talking about, so it quickly says things that are locally sensible but globally inconsistent.

SQueeeeeL 7y ago

But what would be the point... after the novelty wears off, no one considers deep dream anything other than an outcome of the system, not as art with an intended meaning (unless the point of art without meaning)