tldr: Seeing what happens internally in an LLM lets you reconstruct the original prompt exactly. Maybe not surprising if you logged all internal activity, but

tldr: Seeing what happens internally in an LLM lets you reconstruct the original prompt exactly. Maybe not surprising if you logged all internal activity, but it can be done from only a single snapshot of hidden activations from the standard forward pass.