4 ms·

This is the type of project which really interests me. In the future we plan on building a service to wholesale trivia questions to pubs, schools, fundraisers,

This is the type of project which really interests me. In the future we plan on building a service to wholesale trivia questions to pubs, schools, fundraisers, etc. I'll read this paper with interest, because at a quick glance the generated questions do sound great. The next step from generating good quality questions that sound natural, is to make sure the the questions are up to date and topical. This means keeping up with current affairs, memes, popular cultue, and other trends. Adding questions about "which politician is in trouble for x" really only remain relevant for about a week or two and sit in a different category than these pure fact style questions presented here. It would be great to see this research team or others to continue in this direction, and look at an increasingly broad metrics of what makes a "good" question, in addition to whether the English phrasing sounds good. Nevertheless, this really does sound great.

lifeisstillgood 11y ago
This was my first thought too - not "hey pushing back the boundaries of computer science" but "hmmm, way to put pub quizmasters out of business".
- dave_sullivan 11y ago
  Read this paper from July of last year and it'll make more sense as to why this research is interesting: http://arxiv.org/pdf/1506.05869.pdf http://arxiv.org/pdf/1506.05869.pdf. Seeding a dataset with human labels, then generating new, better data is pretty cool. Similar to deep mind watching go games, then learning to play better than said games. Add to which, humans can't tell the difference between the human generated data and algo generated data. We're about 3 months from where you can bootstrap a system like microsofts with freely available code and data. From there, if "memory modules" start working better so models can "remember specific context" (it can already remember general context), you'll have a bot that's a pretty good model for passing the Turing test. I'm defining a practical Turing test as text-based, human gets 5 questions, other party replies 5 times, then human must predict: human/not human.
deleted 11y ago
[deleted]

lifeisstillgood 11y ago

This was my first thought too - not "hey pushing back the boundaries of computer science" but "hmmm, way to put pub quizmasters out of business".

dave_sullivan 11y ago
Read this paper from July of last year and it'll make more sense as to why this research is interesting: http://arxiv.org/pdf/1506.05869.pdf http://arxiv.org/pdf/1506.05869.pdf. Seeding a dataset with human labels, then generating new, better data is pretty cool. Similar to deep mind watching go games, then learning to play better than said games. Add to which, humans can't tell the difference between the human generated data and algo generated data. We're about 3 months from where you can bootstrap a system like microsofts with freely available code and data. From there, if "memory modules" start working better so models can "remember specific context" (it can already remember general context), you'll have a bot that's a pretty good model for passing the Turing test. I'm defining a practical Turing test as text-based, human gets 5 questions, other party replies 5 times, then human must predict: human/not human.

deleted 11y ago

[deleted]