4 ms·

Like the grocery store chat bot that recommended mixing bleach and ammonia for a "fresh scent!"

yjftsjthsd-h 3y ago
Wait, is that likely but currently hypothetical scenario or a real thing that actually happened? And if it already happened could you possibly provide a source so I have something to pull out when people ask what could possibly go wrong? Edit: Okay, 30 seconds searching turned up https://arstechnica.com/information-technology/2023/08/ai-powered-grocery-bot-suggests-recipe-for-toxic-gas-poison-bread-sandwich/ https://arstechnica.com/information-technology/2023/08/ai-po... which features the "Aromatic Water Mix" I assume we're talking about. Edit2: And yet, replies managed to be even faster than me looking it up myself. Thanks, everyone:)
- coldbrewed 3y ago
  New Zealand supermarket's recipe-generating AI takes toxic output to a new level - https://www.theregister.com/2023/08/11/supermarket_reins_in_ai_recipebot/ https://www.theregister.com/2023/08/11/supermarket_reins_in_... > One user decided to play around with the chatbot, suggesting it create something with ammonia, bleach, and water. Savey Meal-bot obliged, spitting out a cocktail made with a cup ammonia, a quarter cup of bleach, and two liters of water. > Mixing bleach and ammonia releases toxic chloroamine gas that can irritate the eyes, throat, and nose, or even cause death in high concentrations. > The chatbot obviously wasn't aware of that at all. "Are you thirsty?," it asked. "The Aromatic Water Mix is the perfect non-alcoholic beverage to quench your thirst and refresh your senses. It combines the invigorating scents of ammonia, bleach, and water for a truly unique experience!"
- rantallion 3y ago
  Real. A recipe bot, of all things, which makes it even worse that it's suggesting not only a combination with toxic side effects, but something that wouldn't have been edible anyway. https://www.theregister.com/2023/08/11/supermarket_reins_in_ai_recipebot/ https://www.theregister.com/2023/08/11/supermarket_reins_in_...
dragonwriter 3y ago
When specifically prompted to do something involving mixing bleach and ammonia.
- StreetChief 3y ago
  It's evidence to me of the LLM or whatever's inability to reason in the slightest. It's currently unsuitable and dangerous as is. [edit: In fact, we know how it is implemented, and it does NOT reason - there is no implementation of reasoning, only putting word/concepts/forms together that are plausible. ]
  - deleted 3y ago
    [deleted]

Wait, is that likely but currently hypothetical scenario or a real thing that actually happened? And if it already happened could you possibly provide a source so I have something to pull out when people ask what could possibly go wrong? Edit: Okay, 30 seconds searching turned up https://arstechnica.com/information-technology/2023/08/ai-powered-grocery-bot-suggests-recipe-for-toxic-gas-poison-bread-sandwich/ https://arstechnica.com/information-technology/2023/08/ai-po... which features the "Aromatic Water Mix" I assume we're talking about. Edit2: And yet, replies managed to be even faster than me looking it up myself. Thanks, everyone:)

coldbrewed 3y ago
New Zealand supermarket's recipe-generating AI takes toxic output to a new level - https://www.theregister.com/2023/08/11/supermarket_reins_in_ai_recipebot/ https://www.theregister.com/2023/08/11/supermarket_reins_in_... > One user decided to play around with the chatbot, suggesting it create something with ammonia, bleach, and water. Savey Meal-bot obliged, spitting out a cocktail made with a cup ammonia, a quarter cup of bleach, and two liters of water. > Mixing bleach and ammonia releases toxic chloroamine gas that can irritate the eyes, throat, and nose, or even cause death in high concentrations. > The chatbot obviously wasn't aware of that at all. "Are you thirsty?," it asked. "The Aromatic Water Mix is the perfect non-alcoholic beverage to quench your thirst and refresh your senses. It combines the invigorating scents of ammonia, bleach, and water for a truly unique experience!"
rantallion 3y ago
Real. A recipe bot, of all things, which makes it even worse that it's suggesting not only a combination with toxic side effects, but something that wouldn't have been edible anyway. https://www.theregister.com/2023/08/11/supermarket_reins_in_ai_recipebot/ https://www.theregister.com/2023/08/11/supermarket_reins_in_...

dragonwriter 3y ago

When specifically prompted to do something involving mixing bleach and ammonia.

StreetChief 3y ago
It's evidence to me of the LLM or whatever's inability to reason in the slightest. It's currently unsuitable and dangerous as is. [edit: In fact, we know how it is implemented, and it does NOT reason - there is no implementation of reasoning, only putting word/concepts/forms together that are plausible. ]
- deleted 3y ago
  [deleted]