4 ms·
The discussion touches on this a bit near the end. The 'human consciousness is specifically important' meme could be harmful as we proceed as an evolutionary en
by rytill 9y ago
The discussion touches on this a bit near the end. The 'human consciousness is specifically important' meme could be harmful as we proceed as an evolutionary entity.
For those who anticipate an AI singularity: it may be harmful to the universe when we decide on an objective function for our GAI that optimizes specifically for human experience.
Humans were produced by a process: reality. We really should optimize the process, if possible, and not just human or human-biased experience.
- jchanimal 9y agoBe careful what you wish for. It may be that what is good in the world (consciousness) is a mere side effect of what makes us effective survivors. Perhaps we could kick off an evolution of compute-based life, which would easily out maneuver us for resources, but has no value. Maybe start here for an idea about why we shouldn't throw certain values under the bus, merely in order to compete: http://slatestarcodex.com/2014/07/30/meditations-on-moloch/ http://slatestarcodex.com/2014/07/30/meditations-on-moloch/
- AgentME 9y agoThe book Blindsight by Peter Watts explores the idea that consciousness might not be necessary for intelligence, and that it may be a temporary stepping stone in the evolution of an intelligent species if it isn't specifically safe-guarded. The book posits a superintelligent alien race^Wsomething without consciousness that views Earth's many broadcasts (which are only valuable to people with consciousness) as a malicious attack or pollution that only serves to waste the processing time of intelligences like itself. It's a great book exploring consciousness and the vast possibility space of intelligence.
- tpeo 9y agoWhat? How do you "optimize" reality?