4 ms·
Edit: society of mind is a great launching point for AI alignment as well. If there are internal processes that "care" about/sense different things, how do they
by sdwr 4y ago
Edit: society of mind is a great launching point for AI alignment as well. If there are internal processes that "care" about/sense different things, how do they work together?
1. Bidding system. Subsystems parse incoming info, and pay to bubble their need/plan into consciousness/action
2. Nested levels of concern, ex. maslow's hierarchy
3. "Recipes" that combine output from multiple subsystems. Learning recipes via subconscious communication / mirroring.
I get the sense AI alignment is too focused on the fantastical end-of-the-world catastrophe scenario. It's impossible to get anything actually done vs a vision of apocalypse. The real strides are going to come from operational safety and "open enough" reasoning, not "how do I know that its not lying about lying about..." paranoid recursing.