2 ms·
I was worried people would run into this quirk in the demo. We have several 'advanced' question generation strategies. You correctly guessed the one we're using
by maxrmk 3y ago
I was worried people would run into this quirk in the demo. We have several 'advanced' question generation strategies. You correctly guessed the one we're using in the demo; forming complex questions by finding another page in the same category as Ripken and pulling more facts.
Normally we pull a ton of related topic and try to pick the best, but to keep the generation fast and cost effective in the demo I limited the number of related pages we pull. So sometimes (like this case) you get something barely related and end up with odd disjointed questions.
- Imnimo 3y agoAh, that does make sense - especially for a category like a baseball player where it may take a lot of other pages to find one that's truly related. Would be expensive for a demo, but not a big deal for a real evaluation.
- maxrmk 3y agoYep, in real use cases the latency for generating questions doesn't really matter. But in the demo I was really worried about it.