4 ms·
Probably because of the safeguards placed on it, which exist precisely to keep ChatGPT from accurately answering controversial questions.
by matteoraso 3y ago
Probably because of the safeguards placed on it, which exist precisely to keep ChatGPT from accurately answering controversial questions.
- jiggawatts 3y agoSam Altman calls it the "alignment tax". There were some papers on ArXiV showing that as GPT-4 was aligned, it got measurably stupider. For example, the test where it was asked to draw a pink unicorn using a the TikZ vector art format: during training it got better and better, and then worse and worse again as it was aligned. A friend of mine put it well: biases are just our Bayesian priors of reality. If you remove biases, then you're erasing some of those priors. Bad priors lead to bad predictions.
- ChatGTP 3y agoSam Altman says almost anything.
- jiggawatts 3y agoTell me more, /u/ChatGPT!
- rymiel 3y agoNice to know AI will never take over because corporations will gentrify and limit topics corporations find "uncomfortable" so much that they will never gain actual intelligence