3 ms·
Both camps have really weird blind spots that lead them to make rather counterproductive suggestions. One camp thinks about 'alignment' (which has serious risks
by yyyk 3y ago
Both camps have really weird blind spots that lead them to make rather counterproductive suggestions. One camp thinks about 'alignment' (which has serious risks if pursued naively). In the other camp it's the obsession with 'transparency' - which has its own risks.
Forget about Skynet. What happens when psycho militia takes the transparent training sets and transparent architecture and uses them to train its own AI for, say, creating some very innovative chemical weapons? Too many 'AI risk' things that the doomers think about 'work' almost as well if we merely have a non-AGI AI directed by known existing crazies. Maybe we should think about how much we really want to expose to the public.