3 ms·
> an earlier Opus was highly committed to animal welfare and they’re not sure why; other versions and models have not been I caught that too, very interesting.
by mritchie712 1y ago
> an earlier Opus was highly committed to animal welfare and they’re not sure why; other versions and models have not been
I caught that too, very interesting.
Many people treat their pets as part of their family. Many people make statements online like: "I like dogs / cats more than most people". So it's not surprising that this sentiment would be picked up in training data. I'd wager animals on average are thought of more highly on a site like Reddit than humans are. i.e. the average sentiment of a post on cats is more positive than a post about a human. Cats, in the training data, may be perceived as "more important" or "better" than humans.
It is surprising Opus holds on to this tighter than other models.
- vessenes 1y agoThe MechInterp guys talk a lot about concept overloading. I wonder if “kind to animals” randomly overlaid with “helpful and not harmful” concepts during training and they got locked in together. All highly speculative obv.