That could rise to the level of serious infraction too, of course. But there is one key difference that makes it worse, which is that a student is not probabili

That could rise to the level of serious infraction too, of course. But there is one key difference that makes it worse, which is that a student is not probabilistic like an LLM is. Given enough output, no matter how well behaved you think your prompt is, the LLM will output something completely off the rails. In fact, it will give every possible output. Can happen to students too (sleep deprivation will do it), but not with the same inevitability as the LLM tool. To phrase another way, you could set up the 'human factor' in a way that you can trust unchecked output from another human (e.g. checking their expertise in academia, or if they are a commercial aircraft pilot, checking their pre-flight notes on how much sleep they got), but not for LLMs.