I am also worried about officers "gaming" the system to bolster whatever stat their superiors want them to optimize at the detriment of those being "policed".

I am also worried about officers "gaming" the system to bolster whatever stat their superiors want them to optimize at the detriment of those being "policed". We've all seen how prompting can change GPT output and this is what worries me the most. Imagine users finding out that starting every interaction that is recorded with a certain sentence acts as a pre prompt that in turn subtly biases the gpt output so that it makes judges or prosecutors less sympathetic to defendants when the police department is optimizing for higher conviction rates, eg. (That is, doing the opposite of the quote above of the public defender "humanizing" the drug case defendant in the plea deal example.) There will be a lot of reports transcribed, people will find ways to optimize the output to their gain and we've all seen how easy it is to bias llm output by promoting.