3 ms·
> “Superalignment” group will be folded into broader research efforts at the company. I think super-alignment and super intelligence are incompatible with each
by RcouF1uZ4gsC 2y ago
> “Superalignment” group will be folded into broader research efforts at the company.
I think super-alignment and super intelligence are incompatible with each other. I think a huge part of intelligence is in examining the basic premises you believe in and being able to work out the implications of that. Look at the Enlightenment and the Renaissance. I don’t think we would have had the Scientific Revolution without the intellectual underpinnings that reshaped how we saw the world.
In addition, super alignment is very hubristic. We are positing that our way of looking at the world is the correct and valid way and there is no better way that could be found even by a super-intelligent entity.
So either “super-alignment” creates entities that are so crippled that it would be hard to call them super intelligent, or else it is just the equivalent of putting an internet “safety” filter on the computer of a teenager that writes open source kernel drivers for fun - something that will quickly be bypassed.
I am glad to see this pseudo-religious BS finally being got rid of.