Tl;dr: I think that a left brain/right brain parallel is in the cards for LLMs Our own brains have multiple neural circuits. Parallel, serial, competing, cumul

Tl;dr: I think that a left brain/right brain parallel is in the cards for LLMs Our own brains have multiple neural circuits. Parallel, serial, competing, cumulative… Including ones which error-check others’ output. I guess the term in the ML niche is ‘adversarial networks’. From the robotics side, there was subsumption architecture which used the real world as a basis for informing decisions. So, I respectfully disagree that fixing up creative but occasionally erroneous networks is papering over the problem. If our own brains use multiple neural circuits to check each other to try to optimize for output that agrees with reality, why would it be preferable or logical to try to create a single artificial neural network that has perfect output? My sense from playing with LLMs is they’re knowledge without understanding. Weirdly akin to my own dreaming consciousness, to the extent that conscious me has seen it. It seems very natural to me that the next step would be integrating checks/validations in parallel and considering each half of a matched ‘whole’. It could still be considered a single network. Just made of two distinct smaller specialized ones.