3 ms·
> Assign a confidence level to segments of generated text. Text generators are not reasoning machines. To assign a confidence level, you need a tree of facts a
by denton-scratch 3y ago
> Assign a confidence level to segments of generated text.
Text generators are not reasoning machines. To assign a confidence level, you need a tree of facts and deductions. This is what you can get from an expert system.
With an expert system, you can in principle ask the system to explain its reasoning, and assign confidence to each step. ML systems are black boxes.
Expert systems are hard to train; you need a human expert, and probably a specialist in the expert system sitting beside him. And it takes a lot of work - so it's expensive.
I can imagine a hybrid expert system/machine-learning system, where the ML system is used to distil the expertise that is then used by the expert system to construct decision trees that are not opaque.
I wish a fraction of the money that gets thrown at LLM "toys" were instead invested in expert systems. I think expert systems research became unfashionable around the end of the 1980s, which is a crying shame.
- rini17 3y agoBasically LLM has no way of knowing that it can't as freely arrange tokens to make case references as it does for other text. Maybe it can be fixed by more parameters or something, not done yet.
- nologic01 3y agoI am not at all pessimistic about expert systems. These things go in cycles and piggybag on developments. NN's were niche for a long time. Speculative hypes act as a sort of Zitterbevegung: moving fast yet going nowhere. But my suggestion is actually less ambitious: not to create confidence with reference to outside knowledge but purely on the basis of the training sample and its intrinsic statistics. [1] https://en.wikipedia.org/wiki/Zitterbewegung https://en.wikipedia.org/wiki/Zitterbewegung