3 ms·
Really throwing the whole kitchen sink at the problem here. They're basically running a RL algo over an ensemble of every successful NLP algo of the last decade
by rayuela 9y ago
Really throwing the whole kitchen sink at the problem here. They're basically running a RL algo over an ensemble of every successful NLP algo of the last decade.
- cs702 9y agoYour summary of the paper is both succint and accurate. What's really interesting to me is that this approach yields state-of-the-art chatbot results, significantly outperforming other, non-ensemble approaches. It makes me wonder if the subconscious part of the human mind does something similar, i.e., when faced with the task of articulating a response, does the brain subconsciously evaluate a range of possible responses, each generated by different subsystems, and then choose the best of these responses or some mixture of them, to respond?
- PaulHoule 9y agoMaybe that, or maybe you have a large number of strategies for generating replies, and you can pick a good one ahead of time, so you don't need to do an exhaustive search. Compare it to how a human chess player looks at several possible moves as opposed to a computer program which will consider thousands.
- Hydraulix989 9y agoAI is still very much a search problem -- leveraging what computers are actually good at doing to try to mimic doing things that they aren't good at.