4 ms·
How do you generate the questions and how do you make sure to not lose information? E.g. Today I woke up at 9.am, had a light breakfast and then went on a run
by ck_one 3y ago
How do you generate the questions and how do you make sure to not lose information?
E.g. Today I woke up at 9.am, had a light breakfast and then went on a run in Golden Gate Park.
What questions do you generate from this sentence?
- redskyluan 3y agoThey generate questions like: where did you go this morning? When did you woke up this morning. What did you do after breakfast? What did you do today at Golden Gate Park. GPT is all about probabilities. So the LLM know what might be most related answer of a doc chunk. It works much better than embedding the whole sentence because "When did you woke up this morning" might not be very similar with "Today I woke up at 9.am, had a light breakfast and then went on a run in Golden Gate Park.".
- ck_one 3y agoInteresting, thank you! Have you played around with different prompts to generate these questions?
- redskyluan 3y agoThat's exactly what I'm trying to do. Play with prompts, generate multiple questions and cluster questions and pick some of the centroid questions to do embeddings