On the second paragraph, there’s been work that shows whether a model has memorized or is strongly replying to certain prompts. Something like that combined wit

On the second paragraph, there’s been work that shows whether a model has memorized or is strongly replying to certain prompts. Something like that combined with a memory-equipped model would tell you if it might contain the info. From there, you need multiple layers building on info it contains to synthesize a reply that might be good. Alternatively, an iterative process going a few rounds through a model, re-presenting the combo of results together, and it fuses them. All based on known data or what’s in the prompt with nothing else. This is speculative based on a few things our own minds do.