4 ms·

Hi, Here is an extremely early stage project that a friend and I have been working on this summer. DeepQuiz generates quiz questions from user-submitted text.

Hi, Here is an extremely early stage project that a friend and I have been working on this summer. DeepQuiz generates quiz questions from user-submitted text. Currently we're using a combination of statistical analysis and heuristic rules to do this - no machine learning. The main point in its favor right now is that it's free to use and pretty fast. We would really appreciate your feedback, as well as ideas for how it could be better, and types of generated questions you would like to see. The system does best with English text.

nessup 9y ago
This looks cool! As you probably already know, it has some ways to go. Simple English Wikipedia would have plenty of content with sentences that are easier to parse. Also, it'd be pretty cool to see general trivia quizzes autogenerated from Wikipedia using your algo.
- gattilorenz 9y ago
  The problem of trivia quizzes is selecting what makes a good trivia quiz. You can't simply "quizzify" any part of any Wikipedia page, or the quiz has a very high chance of being too hard or not interesting at all (trivia: how many people live in the German city of Kraiburg am Inn? 600, 4000, 8000 or 16000?. Even someone interested in German geography is probably not going to enjoy this)
damvigilante 9y ago
This is a pretty cool project! You should take a look at this paper : https://arxiv.org/abs/1705.02012 https://arxiv.org/abs/1705.02012 . Using your heuristics to select the answers, you maybe able to generate some non fill in the blank questions. (All I saw was fill in the blank, not sure if it does other types of questions)
- forrestbrazeal 9y ago
  It also does true/false and multiple choice. Right now the text sample has a lot to do with what kind of questions it can find.
gattilorenz 9y ago
Nice work! My suggestion at the moment is to avoid excessively long true/false questions (unless you actually plan to modify them, but that can be incredibly hard), and to use Named Entity Recognition/detection and semantic similarity (Word2Vec/Glove) for multiple-choice questions. I guess you are already using the former, but with the latter you should be able to really constrain the options to something more "credible".
rocketsentence 9y ago
This is so cool! What kind of tools are you using for the heuristic rules?

nessup 9y ago

This looks cool! As you probably already know, it has some ways to go. Simple English Wikipedia would have plenty of content with sentences that are easier to parse. Also, it'd be pretty cool to see general trivia quizzes autogenerated from Wikipedia using your algo.

gattilorenz 9y ago
The problem of trivia quizzes is selecting what makes a good trivia quiz. You can't simply "quizzify" any part of any Wikipedia page, or the quiz has a very high chance of being too hard or not interesting at all (trivia: how many people live in the German city of Kraiburg am Inn? 600, 4000, 8000 or 16000?. Even someone interested in German geography is probably not going to enjoy this)

damvigilante 9y ago

This is a pretty cool project! You should take a look at this paper : https://arxiv.org/abs/1705.02012 https://arxiv.org/abs/1705.02012 . Using your heuristics to select the answers, you maybe able to generate some non fill in the blank questions. (All I saw was fill in the blank, not sure if it does other types of questions)

forrestbrazeal 9y ago
It also does true/false and multiple choice. Right now the text sample has a lot to do with what kind of questions it can find.

gattilorenz 9y ago

Nice work! My suggestion at the moment is to avoid excessively long true/false questions (unless you actually plan to modify them, but that can be incredibly hard), and to use Named Entity Recognition/detection and semantic similarity (Word2Vec/Glove) for multiple-choice questions. I guess you are already using the former, but with the latter you should be able to really constrain the options to something more "credible".

rocketsentence 9y ago

This is so cool! What kind of tools are you using for the heuristic rules?