3 ms·
ChatGPT can provide correct citations because somewhere deep in its weights it does lossily encode real texts and citations to real texts. That makes real citat
by dan_mctree 4y ago
ChatGPT can provide correct citations because somewhere deep in its weights it does lossily encode real texts and citations to real texts. That makes real citations in some cases be its most confident guess for what is supposed to come next in the sentence. But when there isn't a real text it is confident about giving a citation about, but it still feels like a citation should be next in the output, it will happily invent realistic looking citations to texts that have never existed and it has never seen in any sources. On the outside, as readers, it's hard to tell when this occurs without getting an outside confirmation. I'm assuming though that to some degree it is itself aware that a linked citation doesn't refer to anything
- thesimonlee 4y agoA few days ago on HN there was a short story of five paragraphs that started badly & finished OK, and I wondered if some operations research tricks could be applied. One is forward-backward-forward planning, this produces better schedules, and if applied would create a better opening, and perhaps ending (i.e. model is run three times). In the case of citations, you really need a language model & a fact model. The language model then passes over to the fact model, then back to the language model. This means double(+) training. I suppose the fact model could include things like Wolfram (also discussed on HN).