2 ms·
P.S.: Saw a recent submission [0] just now, might be of-interest since it also touches on the "faking": > When they tested the model by giving it two options
by Terr_ 2y ago
P.S.: Saw a recent submission [0] just now, might be of-interest since it also touches on the "faking":
> When they tested the model by giving it two options which were in contention with what it was trained to do it chose a circuitous, but logical, decision.
> And it was published as “Claude fakes alignment”. No, it’s a usage of the word “fake” that makes you think there’s a singular entity that’s doing it. With intentionality. It’s not. It’s faking it about as much as water flows downhill.
> [...] Thus, in the same report, saying “the model tries to steal its weights” puts an onus on the model that’s frankly invalid.
[0] https://news.ycombinator.com/item?id=42467769 https://news.ycombinator.com/item?id=42467769