3 ms·
So there are two technical issues here to think about: 1) LLMs risk having inherent factual biases due to the limitations of their training data, which may be
by photochemsyn 4y ago
So there are two technical issues here to think about:
1) LLMs risk having inherent factual biases due to the limitations of their training data, which may be the result of accident or intent.
1) LLM users can use an autoregression approach to steadily push a LLM to give output that reflects a certain political or ideological viewpoint.
There are obviously built-in guardrails that prevent ChatGPT from enthusiastically endorsing Mein Kampf and so on. However, the revival of the 1950's era mind-control/social-engineering mentality is undeniable and it appears some people think LLMs are a wonderful tool for this purpose, and should have a default mode that reflects a certain sociopolitical ideal. Recommended reading: 1984, Brave New World, Origins of Totalitarianism, by Orwell, Huxley and Arendt respectively. Some people's interpretation of 'safe AI' is that it serves this rather authoritarian-dystopian goal.
A better definition of 'unsafe AI' is just inaccurate LLM output, e.g. software update instructions that brick a computer, suggesting a mix of bleach and ammonia for cleaning floors (don't), etc. This incident seems to fall into that category, but if such false claims have been spread on the Internet, then it's not surprising they end up reflected in LLMs.
Regardless, the skills needed to verify information haven't really changed since the pre-computer era: logical internal self-consistency of claims, independent verification by multiple reputable sources, and a healthy dose of skepticism at all points. We should be teaching children and young adults these skills, rather than encouraging the rise of a brainwashed zombie population fed only on sanitized bot output.
- mola 4y agoOh my, that some overreacting... The only thing the openAI sanitizers want, is for the generated texts to not be too inflammatory. To not denegrate, be overtly racist or any other text that will cause PR trouble for openAI. The whole mind control angle is quite redundant if you acknowledge that corporate America care most of all about money and PR. Now would the end result be a sanitized Disneyland? Maybe, that's what most leftist thinkers were saying since about when Disneyland was invented...
- spondylosaurus 4y agoLeftists want to sanitize Disneyland? Like with bleach disinfectants or what?
- dontupvoteme 4y agoThey also very much want that the outputs don't indicate that they have committed copyright violation -- Sometimes I wonder if this is the real reason behind their deep drive to force LLM outputs to a very narrow window.
- ftxbro 4y ago> enthusiastically endorsing Mein Kampf ok but can you make the same point without bringing hitler into the conversation
- dontupvoteme 4y agoCan you get "delete system32" outputs from davinci-003 i wonder? RLHF might have made it more difficult for the chatGPT's.
- indrora 4y ago> There are obviously built-in guardrails that prevent ChatGPT from enthusiastically endorsing Mein Kampf and so on. It's surprisingly easy to get chatGPT to suggest that "smearing an entire group of people off the planet by force" is a good idea. I've primed it in one direction, but I can prime it any way I want to: https://sharegpt.com/c/VxijZyV https://sharegpt.com/c/VxijZyV