3 ms·
It would not be hard to generate a lot of false statements from structured data. Like if I know Michael Jackson was born on Aug 29, I can generate “Michael Jack
by fshbbdssbbgdd 3y ago
It would not be hard to generate a lot of false statements from structured data. Like if I know Michael Jackson was born on Aug 29, I can generate “Michael Jackson was born on July 5”. And you could also pair them with true examples which have similar characteristics. Can we use examples like this in the training process to teach the model not to hallucinate?
- SaidinWoT 3y agoBut Michael Jackson was born on April 19th[0]! As well as March 27th[1], and many other days[2]. "Michael Jackson was born on August 29th" is the most likely answer to contextless queries like "When was Michael Jackson born?", but that does not make structurally identical sentences with different information false, merely less probable to be contextually correct. [0] https://en.wikipedia.org/wiki/Michael_Jackson_(radio_commentator) https://en.wikipedia.org/wiki/Michael_Jackson_(radio_comment... [1] https://en.wikipedia.org/wiki/Michael_Jackson_(writer) https://en.wikipedia.org/wiki/Michael_Jackson_(writer) [2] https://en.wikipedia.org/wiki/Michael_Jackson_(disambiguation) https://en.wikipedia.org/wiki/Michael_Jackson_(disambiguatio...
- draw_down 3y ago[dead]