3 ms·
This doesn't make sense. Computers do stuff that people don't "comprehend" all the time. In fact, in the past, one of the fundamental appeals and drives behind
by romaniv 9y ago
This doesn't make sense. Computers do stuff that people don't "comprehend" all the time. In fact, in the past, one of the fundamental appeals and drives behind AI was to make systems that could explain themselves, not requiring complex analysis and experiments to understand what's going on. (And vice vera, systems that could understand humans without programming.)
- smallnamespace 9y ago> make systems that could explain themselves Yes, but currently the systems we are building have no sense of will or agency. If we succeed in building systems that do have more complex objectives, then how can we be sure that the human and machine's objectives are aligned? How can you be sure the system is explaining itself to you in an honest way? Note that there were two different goals in building computers and software: 1) building things that have full control over and 2) building things that are more and more clever and useful. In the limit, those two goals can come into sharp conflict.