>I feel like when I'm awake, I'm building up a context window of stuff that's happening during the day. But when I go to sleep, something magical happens whe

>I feel like when I'm awake, I'm building up a context window of stuff that's happening during the day. But when I go to sleep, something magical happens where I don't think that context window stays around. >There's some process of distillation into the weights of my brain. This happens during sleep and all this stuff. We don't have an equivalent [in LLMs] (23:09) Seems to me that's one of the big things lacking in LLMs vs human thinking. People say LLMs can't lead on to AGI but that kind of thing is an avenue they could explore.