3 ms·
Problem with this is that it requires the software to know what the target is when question is asked and I don’t see it as reliable as there are many ways to as
by m3kw9 4y ago
Problem with this is that it requires the software to know what the target is when question is asked and I don’t see it as reliable as there are many ways to ask and could have many targets
- williamcotton 4y agoI don’t really understand your criticism but I’d be happy to continue a dialog to find out why you mean! There’s probably a little too much going on with that project, including generating datasets for fine-tuning, which is the reason for comparing with a known answer. It is very similar to the approach used by the Toolformer team. But by teaching an agent to use a tool like Wikipedia or Duck Duck Go search it dramatically reduces factual errors, especially those related to exact numbers. Here’s a more general overview of the approach: From Prompt Alchemy to Prompt Engineering: An Introduction to Analytic Augmentation https://github.com/williamcotton/empirical-philosophy/blob/main/articles/from-prompt-alchemy-to-prompt-engineering-an-introduction-to-analytic-agumentation.md https://github.com/williamcotton/empirical-philosophy/blob/m...