There are some bugs/exploits for chatbots that are like “if I repeatedly ask for ‘extra rare’ when ordering my burger, the restaurant will serve me a raw ground

There are some bugs/exploits for chatbots that are like “if I repeatedly ask for ‘extra rare’ when ordering my burger, the restaurant will serve me a raw ground beef patty”. These are dangerous. There are other bugs/exploits that are like “if I ask for ‘none beef, no sides, hold the toppings’, the restaurant will serve me an empty box without any food”. These are much less dangerous. I won’t deny that it’s very cool and novel that it apparently works at all restaurants regardless of what they serve. I’d be fascinated to read an explanation of why that is. Fundamental property of the architecture? Something accidentally present in every data set? A fundamental property of textual data sets themselves? But based on the apathetic reactions the author has received, it seems like providers universally agree this is a bug of the second kind. One is perhaps reminded of the old tale of the man who goes to the doctor and says “it hurts when I do this” - to which the doctor says “don’t do that, then”.