Maybe, but there are a lot of unknowns. Does the "memorization on the fly" come with catastrophic forgetting of other information? How does one control for memo

Maybe, but there are a lot of unknowns. Does the "memorization on the fly" come with catastrophic forgetting of other information? How does one control for memorizing recent stuff vs. remembering older stuff?