3 ms·

This post is fucking catnip for me. I still believe society of mind is due for a huge resurgence, due to exactly what you're saying. Bottom-up composable skills

by sdwr 4y ago

This post is fucking catnip for me. I still believe society of mind is due for a huge resurgence, due to exactly what you're saying. Bottom-up composable skills will be a huge step forward, and free up GPT etc to be creative while getting the low-level stuff 100% correct (instead of screwing up arithmetic half the time) The inverse side of the coin is emotions, meaningful relationships, and wisdom, which I think work in similar way but more diffuse. There can be a horny submodule that analyzes incoming content for sexual context, one for anger, fear, gratitude, etc. The same way an image processor convolves over pixels looking for edges and features, an emotional processor will operate over data looking for changes in relationships. Feelings act like filters on incoming data, and are composed out of base physiological reactions. Like anger involves adrenaline, which increases pain tolerance and dampens conscious thought in favor of subconscious and instant reactions.

FredPret 4y ago
This makes so much intuitive sense to me. I love society of mind, I wonder if it bears a relationship to how the human mind works
- tern 4y ago
  Absolutely, see Internal Family Systems. With a little practice, you can empirically determine that this is how your mind and emotions work. https://ifs-institute.com/ https://ifs-institute.com/
sdwr 4y ago
Edit: society of mind is a great launching point for AI alignment as well. If there are internal processes that "care" about/sense different things, how do they work together? 1. Bidding system. Subsystems parse incoming info, and pay to bubble their need/plan into consciousness/action 2. Nested levels of concern, ex. maslow's hierarchy 3. "Recipes" that combine output from multiple subsystems. Learning recipes via subconscious communication / mirroring. I get the sense AI alignment is too focused on the fantastical end-of-the-world catastrophe scenario. It's impossible to get anything actually done vs a vision of apocalypse. The real strides are going to come from operational safety and "open enough" reasoning, not "how do I know that its not lying about lying about..." paranoid recursing.

by sdwr 4y ago

FredPret 4y ago

This makes so much intuitive sense to me. I love society of mind, I wonder if it bears a relationship to how the human mind works

tern 4y ago
Absolutely, see Internal Family Systems. With a little practice, you can empirically determine that this is how your mind and emotions work. https://ifs-institute.com/ https://ifs-institute.com/

sdwr 4y ago

Edit: society of mind is a great launching point for AI alignment as well. If there are internal processes that "care" about/sense different things, how do they work together? 1. Bidding system. Subsystems parse incoming info, and pay to bubble their need/plan into consciousness/action 2. Nested levels of concern, ex. maslow's hierarchy 3. "Recipes" that combine output from multiple subsystems. Learning recipes via subconscious communication / mirroring. I get the sense AI alignment is too focused on the fantastical end-of-the-world catastrophe scenario. It's impossible to get anything actually done vs a vision of apocalypse. The real strides are going to come from operational safety and "open enough" reasoning, not "how do I know that its not lying about lying about..." paranoid recursing.