Agreed. While not directly applicable, I was a huge fan of Mozilla's rr [0] in undergrad. Quoting their site: > rr records a group of Linux user-space processe

Agreed. While not directly applicable, I was a huge fan of Mozilla's rr [0] in undergrad. Quoting their site: > rr records a group of Linux user-space processes and captures all inputs to those processes from the kernel, plus any nondeterministic CPU effects performed by those processes (of which there are very few). I think the solution will resemble that. You don't control the LLM, sure. But you can control what it sees, and maybe that's good enough. [0] https://rr-project.org/ https://rr-project.org/