3 ms·

You definitely need a model of the world, but you probably don't want to be constructing it during speech. What you want is a generative model that you've train

You definitely need a model of the world, but you probably don't want to be constructing it during speech. What you want is a generative model that you've trained on the simulation data ahead of time so you can quickly make inferences once deployed.

grawprog 7y ago
How would that make a conversation more lifelike? It'll still be a limited model of the world, unless somehow you intend to give it the entire breadth of human experience, and will still fall to the same shortcomings as every chatbot, ask it about something it doesn't know and it'll try and fit a response that gives it away as a bot, act confused in a way that gives it away as a bot or just say something nonsensical. There's things like metaphors, slang, topical references, all things that end up in conversations that change regularly in their meaning and usage. Then there's the unspoken parts of conversations. The implications behind different wordings, ways of writing things, words left unsaid, sarcasm, tone(even in text tone is conveyed in some form). Humans do all these things while conversing almost subconsciously, each individual person does these things and comprehends these things uniquely based on years and years of sensory input and model building from a huge variety of sources, in a way that's individually unique and poorly understood. How would you even begin to train a model to even a remote semblance of that?
- Polylactic_acid 7y ago
  You don't even have to trick it with slang. Maybe I am behind but so far I have never seen a bot that can consistently or even most of the time understand context. They seem to all seriously struggle with anything more than a random sentence that was determined a probable result of the last message the user sent.
- rland 7y ago
  Well, often times human beings miss metaphors, slang, and topical references, especially if they are speaking in another cultural group. The gulf between even the most disparate human tribes is nothing compared to the gulf between an AI chat-bot and a human being. I think it's entirely possible to make bots with simple models of the world. (Not that this is really a move any closer to that)
- andbberger 7y ago
  Kind of an open problem on how to make a generative model which is sufficiently powerful :) But that is basically what humans do - we don't run internal simulations, we have a model we've trained over a lifetime of experiences with the world that judges the likelihood of a given scenario

grawprog 7y ago

How would that make a conversation more lifelike? It'll still be a limited model of the world, unless somehow you intend to give it the entire breadth of human experience, and will still fall to the same shortcomings as every chatbot, ask it about something it doesn't know and it'll try and fit a response that gives it away as a bot, act confused in a way that gives it away as a bot or just say something nonsensical. There's things like metaphors, slang, topical references, all things that end up in conversations that change regularly in their meaning and usage. Then there's the unspoken parts of conversations. The implications behind different wordings, ways of writing things, words left unsaid, sarcasm, tone(even in text tone is conveyed in some form). Humans do all these things while conversing almost subconsciously, each individual person does these things and comprehends these things uniquely based on years and years of sensory input and model building from a huge variety of sources, in a way that's individually unique and poorly understood. How would you even begin to train a model to even a remote semblance of that?

Polylactic_acid 7y ago
You don't even have to trick it with slang. Maybe I am behind but so far I have never seen a bot that can consistently or even most of the time understand context. They seem to all seriously struggle with anything more than a random sentence that was determined a probable result of the last message the user sent.
rland 7y ago
Well, often times human beings miss metaphors, slang, and topical references, especially if they are speaking in another cultural group. The gulf between even the most disparate human tribes is nothing compared to the gulf between an AI chat-bot and a human being. I think it's entirely possible to make bots with simple models of the world. (Not that this is really a move any closer to that)
andbberger 7y ago
Kind of an open problem on how to make a generative model which is sufficiently powerful :) But that is basically what humans do - we don't run internal simulations, we have a model we've trained over a lifetime of experiences with the world that judges the likelihood of a given scenario