5 ms·
One strategy(not directly related to ChatGPT) is to use two models, one for extraction/generation and the other "challenger" to verify the extracted answer. Ref
by constantinum 2y ago
One strategy(not directly related to ChatGPT) is to use two models, one for extraction/generation and the other "challenger" to verify the extracted answer.
Refer: https://docs.unstract.com/editions/cloud_edition#llmchallenge-use-llm-applications-with-confidence https://docs.unstract.com/editions/cloud_edition#llmchalleng...
- bosco_mcnasty 2y agocould the generator and challenger be cross trained against each other, so as to actually both get better? like a generative-challenger network (GCN) or something like this?
- langcss 2y agoI think this is how RLHF actually works. https://huyenchip.com/2023/05/02/rlhf.html#3_1_reward_model https://huyenchip.com/2023/05/02/rlhf.html#3_1_reward_model
- trte9343r4 2y agoI use the same strategy. More like an interview. Many AI related tricks can be automated.