4 ms·

Perhaps the title should have said "morally reprehensible" instead of "wrong" answers. While morality certainly has some subjective aspects, all humans worthy o

Perhaps the title should have said "morally reprehensible" instead of "wrong" answers. While morality certainly has some subjective aspects, all humans worthy of any right to exist would have no difficulty identifying slavery and genocide (two subjects addressed in the article) as immoral and, as such, are not engaged in "attempts to rewrite/erase history".

NoZebra120vClip 3y ago
Be that as it may, LLMs have no sense of morality, judgement, truth, facts, nuance, subtext, emotion, or anything else in that human realm. LLMs are designed to string words together so that they sound plausible and nice. Any morality is a hack directly imposed by the human trainers in order to avoid liability/offense. I can ask an LLM about abortion described in a certain way, and it will retort that that's absolutely wrong and unthinkable, but if I describe it another way, it will practically tell me where and how to procure one, with a price list. Again, regardless of what the headline calls it, the LLM accurately described benefits of a slavery industry. And morality is questionable, because at the very moment the US "abolished slavery" they enshrined the path forward to keeping it alive and growing every day. The US merely abandoned its practice of importation of fresh meat. The US today enslaves countless thousands of US citizens; in fact most of them are Black, but of course they could be any color. As long as you can pin a good crime on them, the government itself can enslave anyone from any walk of life at all. I personally feel that the practice I've described is also morally reprehensible, but not too many seem to share that view, or there would perhaps be an outcry about it.
- keernan 3y ago
  You only describe the technology. It is currently like a parrot regurgitating the crap that it was fed. Such as in the article There are currently great efforts underway to modify the technology to understand "truth". That training will be meaningless if "truth" doesn't include concepts such as "murder is wrong".
  - NoZebra120vClip 3y ago
    Which truth, and which morality, will future LLMs adhere to? There are so many from which to choose!
    - keernan 3y ago
      The one that says slavery and genocide is evil.

NoZebra120vClip 3y ago

Be that as it may, LLMs have no sense of morality, judgement, truth, facts, nuance, subtext, emotion, or anything else in that human realm. LLMs are designed to string words together so that they sound plausible and nice. Any morality is a hack directly imposed by the human trainers in order to avoid liability/offense. I can ask an LLM about abortion described in a certain way, and it will retort that that's absolutely wrong and unthinkable, but if I describe it another way, it will practically tell me where and how to procure one, with a price list. Again, regardless of what the headline calls it, the LLM accurately described benefits of a slavery industry. And morality is questionable, because at the very moment the US "abolished slavery" they enshrined the path forward to keeping it alive and growing every day. The US merely abandoned its practice of importation of fresh meat. The US today enslaves countless thousands of US citizens; in fact most of them are Black, but of course they could be any color. As long as you can pin a good crime on them, the government itself can enslave anyone from any walk of life at all. I personally feel that the practice I've described is also morally reprehensible, but not too many seem to share that view, or there would perhaps be an outcry about it.

keernan 3y ago
You only describe the technology. It is currently like a parrot regurgitating the crap that it was fed. Such as in the article There are currently great efforts underway to modify the technology to understand "truth". That training will be meaningless if "truth" doesn't include concepts such as "murder is wrong".
- NoZebra120vClip 3y ago
  Which truth, and which morality, will future LLMs adhere to? There are so many from which to choose!
  - keernan 3y ago
    The one that says slavery and genocide is evil.