well... what we have an an LLM doesn't is state and feedback and restraint, a sense of time. We have an internal state of some kind, an LLM cheats having a sta

well... what we have an an LLM doesn't is state and feedback and restraint, a sense of time. We have an internal state of some kind, an LLM cheats having a state by having every input be the entire conversation + one new input. making the context grow overtime making that state unsustainable. The other thing an LLM is missing is proper feedback, it receives text chunk prompts and output text chunks. since it's output will never 'change the llm's internal state', it can not have a feedback loop. It can mimic one with the trick of refeeding messages as context, but that's untenable after a certain size input. Another is restraint, we human's don't have to respond to everything. we can choose to ignore input entirely, leave people on read, etc... LLM's respond to each input regardless of it is appropriate, and they only respond to stimuli (maybe we do as well, just subtle real world effects). last is a sense of time, which I don't see how the LLM can manage at all. It has no clock. Give an LLM a rich state (okay, maybe rename it too), have it be 'always on', give it a camera and microphone feed for inputs, give it a robot arm to control (pass the output of that back into the model for feedback), give it a second brain to decided to talk or not, and give it a clock too... and what comes out would look leagues better than current AI.