13 ms·
The concern that EAs have about AI alignment is that there is practically no satisfying theoretical framework right now for how to build "safe" AI, and that's k
by bpodgursky 4y ago
The concern that EAs have about AI alignment is that there is practically no satisfying theoretical framework right now for how to build "safe" AI, and that's kinda concerning as we approach human-emulating AI (at least in the realm of chatbots, art, writing...)
There are hotfixes people add on for edge cases like "don't label people as gorillas" or "don't say certain words that Nazis say", but for problems like "don't ever initiate a conversation likely to cause someone to commit suicide"... there's no foundational work (that's not super vague) that compels an AI to optimize for human success and life.
That's not great IMO, and we should probably dedicate as much money to it as we dedicate to, I dunno, potato chips ($65 billion a year in the US IIRC).