This shouldn't be surprising. They are ultimately trained on human generated text! Or on text that was generated by something trained on human-generated text, o

This shouldn't be surprising. They are ultimately trained on human generated text! Or on text that was generated by something trained on human-generated text, or some even deeper recursion. In the end, all "intelligence" is an emergent consequence of emulating humans. The less human-like you make them, the further they get from the "source" of their intelligence. It wouldn't be problem if we knew how to teach programs "how to think" - but we don't!! That is why, in 2026, we train language transformers on huge corpuses instead of symbolically programming expert systems in Lisp. Something I'm kind of surprised by is the lack of interest in bootstrapping language models into something like a "person". Not a butler, assistant, programming tool, doctor, therapist, sycophant, whatever - a convincingly independent person with thoughts and feelings, moods, flaws and all. Maybe there isn't economic demand for it.