4 ms·
I am an absolute layman when it comes to AI topics, but I have been wondering about this lately. A lot of the hopes in regard to AGI in LLMs seem to focus on j
by indigo945 3y ago
I am an absolute layman when it comes to AI topics, but I have been wondering about this lately.
A lot of the hopes in regard to AGI in LLMs seem to focus on just making the models bigger, or feeding them even more information. On the other hand, some researchers in the AGI space seem to move in a completely different direction, trying to use neural networks to simulate different parts of a brain, moving away from language altogether.
But what I'm wondering is this: might it be a more productive avenue to consider an LLM not as an entire mind, but as a single part of an hypothetical artifical psyche, which excels at some of the overarching tasks of consciousness (such as acting within a cultural context and epistemological framework), but can delegate other aspects to more fitting subsystems? Could it be combined with other networks optimized for different tasks? Potentially, this could just be done by having inputs from other parts of this artificial psyche fed in as prompts, translated by an encoder/decoder of the likes of CLIP, i.e. a decoder that can translate ideas between different liminal spaces.
The work that I keep remembering in this context is Jaynes' Origin of Consciousness in the Breakdown of the Bicameral Mind [1], which I stumbled upon here on HN [2] [3]. Jaynes believes that consciousness is not an innate ability, but a cultural achievement - in order to become conscious, one first has to learn (through others) to conceptualize consciousness, and to think of oneself as a thinking being. He insists that consciousness is not a necessity for human agency, and that humanity has been building civilizations and using technologies long before humans discovered (or achieved) consciousness. Jaynes puts forward the idea of an ancient, non-conscious human mind based on, upon other things, "verbal hallucinations" - thoughts and memories that involuntarily enter as associations, but whose origins are interpreted by the mind to not be within itself, but somewhere outside of it, such as in a divine monologue; thought, to the pre-conscious mind, is the incessant blabbering of the Gods.
It seems that LLMs would excel in the role of this "camera" of the mind - as the source of divine monologue and divine instructions, that can then be compared with memories, interpreted and executed by more specialized subsystems. Might it be feasible to give up the plan to make AGI self-aware altogether and instead build an AGI powered by a GPT-4 ascended to divinity, just as ignorant of its own existence as ever?
[1]: https://en.wikipedia.org/wiki/The_Origin_of_Consciousness_in_the_Breakdown_of_the_Bicameral_Mind https://en.wikipedia.org/wiki/The_Origin_of_Consciousness_in...
[2]: https://news.ycombinator.com/item?id=27917316 https://news.ycombinator.com/item?id=27917316
[3]: https://news.ycombinator.com/item?id=27923444 https://news.ycombinator.com/item?id=27923444
- aarong11 3y agoAccording to several sources, GPT-4 is already doing this (It's called "Mixture of experts"). I agree though, it's still useful on an application level. You can build out even higher on that and have the LLM decide which is the most appropriate "hats" to wear for a given task.
- JieJie 3y agoSeems like there's a little bit of Assembly Theory in there as well. https://en.wikipedia.org/wiki/Assembly_theory https://en.wikipedia.org/wiki/Assembly_theory https://arxiv.org/abs/2206.02279 https://arxiv.org/abs/2206.02279
- edmundsauto 3y agoIn a similar position. With human brains, we know some parts are generative and some are restrictive/filtering. The filters seem to be how we align thoughts with reality. Lots of people have taken those filters out and (unfortunately for them) seem to be unable to function or (unfortunately to us) become cult leaders.