Not necessarily. Even in people, memory is (albeit very complex) retrieval. I mean, how many of your x years of memories are in the forefront on your mind at an

Not necessarily. Even in people, memory is (albeit very complex) retrieval. I mean, how many of your x years of memories are in the forefront on your mind at any given moment? Not the creator so i won't make any definite statements on how it works on the memory side but if you embedded and stored the chain of thought "how to use x API" generations and then retrieved them anytime the model was going to use the same API, it would certainly simulate a memory of sorts without needing any incremental training.