The stimulus space provided by wallstreet is incredibly impoverished. While a bundle of algos that deal with text and numbers (and has quite a bit of agency) mi

The stimulus space provided by wallstreet is incredibly impoverished. While a bundle of algos that deal with text and numbers (and has quite a bit of agency) might one day develop into something very similar to what we call consciousness I suspect we will have an extremely hard time recognizing it. We really have zero way to measure consciousness. Autonomous agency? Yes, there are already machines that build their own models and take action based on them (most people, rightly or wrongly, don't consider them to be conscious). Perhaps wallstreet will seek to create algos that examine themselves as part of their model of the world but that can lead to some nasty chaotic behavior, and without having some sense of 'being' in the world that informs its own actions I might argue that we can simply point to the Chinese room experiment and suggest that we come up with better measures for whatever it is we refer to when talking about consciousness. I might also note that the author grossly oversimplifies human beings and the vast amount and diversity of information our nervous system is continually collecting and processing without our awareness that ultimately feeds into consciousness. Also worth noting that our experience of consciousness is very much a fabrication created by our brain to impose consistency on the world (my go to example, used here before being our blind spot). I'm not so sure that wallstreet really wants to replicate the kind of 'filling in' that seems to be a critical part of our conscious experience.