I think there's a parallel in surveillance systems. For example, it's perfectly reasonable for a police officer conducting an investigation to follow a suspect

I think there's a parallel in surveillance systems. For example, it's perfectly reasonable for a police officer conducting an investigation to follow a suspect as they drive around town. After all, it's happening in public and it's not illegal to watch what someone does in public (caveat being taking it to the level of stalking). However, is it reasonable to write an AI system that monitors the time and location of all license plates seen around town, puts them into a database, and then that same officer can simply put in the suspect's license plate instead of actually following them around? Maybe, maybe not, that's not my point here. But the creation of that functionality can easily lead to its abuse. Is this exactly the same case as Copilot? Of course not, these are two wildly different systems. But I think it's an interesting parallel to consider when discussing the point of "it's okay when a human does it" because humans and algorithms operate at two very different levels of scale. The potential for abuse of the latter being far higher and far easier than something a human has to do manually.