One thing that we're trying to hit is the actual quality of the generated questions/answers; there's an immense amount of variance in internet content at large

One thing that we're trying to hit is the actual quality of the generated questions/answers; there's an immense amount of variance in internet content at large and it's difficult to ensure high-quality content without some kind of supervised QA (aside from some kind of hyperparam grid search). We were able to achieve some control over quality through rule-based heuristic filters on our generated questions, but we're trying to make this more robust.