Yes, and I also imagine some kind of AI thing would be useful for reading logs and writing other tests that document what the system does in a nice bdd style.

Yes, and I also imagine some kind of AI thing would be useful for reading logs and writing other tests that document what the system does in a nice bdd style. But you still have to read the tests and decide if that's what you want the code to do, and make sure the descriptions aren't gobbledygook.