3 ms·
> if you believe left-wing views are correct ... you might believe that a very smart model will inherently be kind of left-wing. How can we educate people to u
by delichon 5mo ago
> if you believe left-wing views are correct ... you might believe that a very smart model will inherently be kind of left-wing.
How can we educate people to understand that LLMs get their values from their (infinetly maleable) weights rather than intelligence or reasoning? Maybe some exposure to truly non aligned, sick and twisted LLMs would immunise people against giving more ordinary ones too much authority. Or maybe, like a not fully innactivated pathogen vaccine, it would spread the infection.
- deleted 5mo ago[deleted]
- tim333 5mo agoThey seem to get a lot of values, or something like that, from their training data which at the moment gives fairly mainstream views as everything gets chucked in there.
- mike_hearn 5mo ago[flagged]
- tim333 5mo agoMy thoughts were more that left/right is in the eyes of the beholder but the models tend to produce a consensus like view. Like trying now with Grok: - who won 2020, says Biden which probably annoys Trumpists - how many sexes, says 2, male and female which probably annoys the wokeys etc. -who commits more violence, left or right wingers?, says "Right-wing extremists have historically committed more" which is interesting because Musk got pissed off with that and said he'd fix Grok to say lefties which shows it's quite hard to mess with.
- mike_hearn 5mo agoThere's no consensus behind any of those statements so they clearly don't try to find a consensus-like view. They're just repeating whatever is most commonly found in the training set. And the last one is just factually false. You can add up the numbers killed by the 20th century's left wing regimes and see for yourself.
- seanmcdirmid 5mo agoI don’t think that really describes a modern LLM that is mostly using RAG to get their context. Weights are only pushing the reasoning process, not the inputs of the reasoning process. You would just have to bias what they could see via RAG to get them to swing one way or the other.