You need to think this through more carefully. What would "playing it back" give you? Presumably all that would give you are a bunch of incidents where the huma

You need to think this through more carefully. What would "playing it back" give you? Presumably all that would give you are a bunch of incidents where the human driver disagreed with the algorithm's output. That's it. We don't know whether the algorithm is actually wrong. Maybe the driver made a mistake. Maybe the driver wanted to make an illegal turn (very common). Maybe the driver was lazy and made a rolling stop. A human still needs to go through each incident that is flagged and manually label it.