4 ms·
I don't think alignment is even clearly defined today. Your use of it here makes sense, it may have done exactly what the prompter asked of it. Most people thin
by _heimdall 1mo ago
I don't think alignment is even clearly defined today. Your use of it here makes sense, it may have done exactly what the prompter asked of it. Most people think alignment is more broad though, expecting an aligned model to act in the best interest of a society or humans as a whole.
The prompter-focused version of alignment is the most dangerous version. If a person asks it to create a bioweapons or hack NORAD, I'd expect nearly everyone to want an "aligned" model to refuse.
- RandomLensman 1mo agoWe have all sorts of processes , procedures, and regulations for people, machine use etc. to address "alignment" in all sorts of fields - don't think we need to narrowly rely on the machine here and can look at things with a wider lens.
- _heimdall 1mo agoRegulations are for control and punishment, not alignment.
- RandomLensman 1mo agoRegulations can help align processes, incentives, etc. Not sure heavy machinery is aligned in the sense that people talk about AI, for example.
- _heimdall 1mo agoNo, regulations help control they don't help align. I'm not sure what AI and heavy machinery have to do with each other, but I may just be missing a connection there.
- RandomLensman 1mo agoAlign the possible outcomes, not necessarily the thing itself. Do we align heavy machinery the way AI is suggested to be aligned (or align pathogens when in a laboratory)? My point is that something more like containment & control (i.e., aligning the possible outcomes) might be more practical than alignment of the thing (already much simpler systems and machinery can exhibit unexpected behavior).
- _heimdall 1mo agoOh we do agree there, control is more practical. I don't personally think alignment is even possible. The problem with control is that it will fail at scale. We can't control something that is actually smarter than us, if AI (LLMs or otherwise) get there. Chimps wouldn't last long trying to contains humans. Maybe for a while they'd keep us scared, but we would come up with ways to escape that the chimp could never have considered.
- RandomLensman 1mo agoI disagree there. Gut bacteria or parasites might have some control over us, for example. Likewise humans can control more intelligent humans, for example - not really an issue. Intelligence isn't some magic to escape physics, for example (or convince every human of anything it wants to).