3 ms·
Not a "paperclip optimizer", but a "weather prediction optimizer" - nice!
by kkjjkgjjgg 5y ago
Not a "paperclip optimizer", but a "weather prediction optimizer" - nice!
- mdp2021 5y agoMy expression fell under the vibes of the more generic "paperclip maximizer argument" because I wanted to remain faithful to the "weather" idea, but could not get a better image. Nonetheless, the details of the "paperclip maximizer argument" are valid, though not primary, for the real point: AI applied to strategy, tactics, defence and weapon management can suffer from the "Orthogonality thesis" (the decision may be out of a process unaware of human values) and "Instrumental convergence" (the decision may be out of a process unaware of its legitimate boundaries). The primary point remains "You do not put an "enfant prodige" in charge of systems with overextensive consequences".