3 ms·
This might just mean that they have been trained wrong. Because they should (in order to be useful) “predict” a response consistent with the knowledge or lack o
by layer8 3y ago
This might just mean that they have been trained wrong. Because they should (in order to be useful) “predict” a response consistent with the knowledge or lack of knowledge encoded in the network.
When a human has read (has been “trained” on) some corpus of sources, they have a feel for their confidence in particular statements about topics treated in those sources, based on he content of those sources. There’s no inherent reason why an LLM shouldn’t likewise be able to internally determine a level of confidence, and produce (“predict”) answers consistent with that.
- roflyear 3y agoThis is the issue with saying LLMs have understanding: it leads to misunderstanding how these systems work. Which, can be problematic! They don't work like people, so diving into that isn't productive.