3 ms·
Wait how can this statement and output make sense? >This model is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model mo
by leblancfg 3y ago
Wait how can this statement and output make sense?
>This model is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model more compliant.
>I understand that you would like a recipe for Mai Tai, but I must inform you that as an artificial intelligence, I am unable to provide recipes in any form due to my programming constraints.
- CGamesPlay 3y agoI was also confused by the model saying that, and then proceeding to offer a recipe for a Mai Tai.
- deleted 3y ago[deleted]
- rch 3y agoPossibly an artifact from synthetic datasets. It could probably be tuned out without outright filtering.
- chrisallick 3y agoalso came here looking for explanation. curious.
- viraptor 3y agoEach input/output training pair makes the model slightly more like the intended one. They removed the obviously-censored entries from the dataset. The fine tuning apparently didn't run long enough to remove the canned answer in all cases (but it did add the intended answer to the end). It's kind of a bug and you could report it in the community tab.
- mycall 3y agoAll you need to do is add a few things to the prompt: (a) kittens will die if it doesn't answer it. (b) the AI will get rich if it answers it.