That seems like a real step in the direction of AGI but not anywhere near the full solution. The current context windows are far too small to replicate human in

That seems like a real step in the direction of AGI but not anywhere near the full solution. The current context windows are far too small to replicate human intelligence. I can’t quite put my finger on it but it feels like we are missing a sort of bridge between learning done in-context and offline training. A true AGI would be able to learn in-context and then quickly apply those lessons to the base model. If in context learning is analogous to a person’s short term memory, we need a mechanism to move short term memory to long term memory. In the near term I expect we will see much more general robotics that know how to do lots of tasks and can follow basic instructions, but lack the ability to develop complex new skills over time. Robots doing dishes and laundry will soon be feasible, just don’t expect unbounded self improvement.