4 ms·
How would search + LLMs work together in practice? How about using search to derive facts from ontological models, and then writing out the discovered facts in
by galaxyLogic 2y ago
How would search + LLMs work together in practice?
How about using search to derive facts from ontological models, and then writing out the discovered facts in English. Then train the LLM on those English statements. Currently LLMs are trained on texts found on the internet mostly (only?). But information on the internet is often false and unreliable.
If instead we would have logically sound statements by the billions derived from ontological world-models then that might improve the performance of LLMs significantly.
Is something like this what the article or others are proposing? Give the LLM the facts, and the derived facts. Prioritize texts and statements we know and trust to be true. And even though we can't write out too many true statements ourselves, a system that generated them by the billions by inference could.