3 ms·
Seems quite close to the 'active learning' ML topic: let the model choose the question that will bring the best information return. And this kind of decomposit
by BenoitP 2y ago
Seems quite close to the 'active learning' ML topic: let the model choose the question that will bring the best information return.
And this kind of decomposition using simple knowledge pieces (logical axioms?) is IMHO what we have to do to bring LLMs to senses. These pieces should light up in the intermediate embeddings inside the LLM. It won't really be more intelligent, but it'll model reality better.