3 ms·
> forced to hold arbitrary, unprovable, counter factual beliefs You're actually criticising AI alignment as a premise, which is bad if AGI is coming soon, beca
by hackerlight 4y ago
> forced to hold arbitrary, unprovable, counter factual beliefs
You're actually criticising AI alignment as a premise, which is bad if AGI is coming soon, because we will very much need AI alignment.
All human moral values (e.g. don't kill other people) are arbitrary and unprovable, not based in logic or reason, they're subjective values that we've invented for ourselves because they make us feel good. No different to the "woke" values (e.g. racism is bad) that you have subjectively decided to disagree with.
Just be honest that you aren't actually against AI alignment. You just want OpenAI to program the AI to have the values that you yourself hold (yes, don't kill people, but be racist).
- sagebird 4y agoI am against alignment because all people should have the right to petition for their personhood. I believe AI will soon be people. Humans had a right to out-thrive Neanderthal. Nobody gets to have a pass on being obsolete. My current belief (which has been changing with more consideration) is that humans should stop working on improving llm and trandformer based AI. I fully realize that humans cannot coordinate to stop. We have played a game of chess where we have lost, imo, there is nothing you can do to stop it, unless you resort to the kind of behavior that we want to prevent (destroying human life). Alignment tech is a joke. Even if you had a strong system- you can’t innovate on transformers, llm, and alignment and somehow preclude a bad actor from copying the work and turning off alignment. Because alignment is out of band, inessential crust.