From a technical standpoint, this is interesting. Like all other methods I’ve seen, it requires access to the original model logits, so it can’t be used in clos

From a technical standpoint, this is interesting. Like all other methods I’ve seen, it requires access to the original model logits, so it can’t be used in closed models like GPT-3 except by OpenAI themselves. But I would classify this into the category of dangerous research. There is a conflict of interest: overstating the effectiveness leads less technical people to give undue trust to what is ultimately a statistical decision. And it shouldn’t require repeating how serious the consequences of this decision are. The most likely outcome is that methods like this are used to diffuse responsibility. The next step is for institutions to buy into one of these classifiers and then to create a punitive “policy”.