Is this the way we work? We are told a fact a very few times and we remember it all life long, no 32k or 32M context. I think that they are following the easy

Is this the way we work? We are told a fact a very few times and we remember it all life long, no 32k or 32M context. I think that they are following the easy path, much like the Giga Hertz race in CPU, and will hit a wall. Maybe the wall will be so far away that it will give us an AGI but maybe it will give us superhuman machines only in well defined contexts. We'll have to squeeze our instructions in a prompt too small for some tasks and get a bot behaving like the main character of the Memento movie (he remembered only the last few minutes and very old memories.)