5 ms·

This is what every company is doing in the name of integrating "Gen AI". 90% of it is chat bots. And in 90% of those places I dont want a chat bot.

StreetChief 3y ago
Like the grocery store chat bot that recommended mixing bleach and ammonia for a "fresh scent!"
- yjftsjthsd-h 3y ago
  Wait, is that likely but currently hypothetical scenario or a real thing that actually happened? And if it already happened could you possibly provide a source so I have something to pull out when people ask what could possibly go wrong? Edit: Okay, 30 seconds searching turned up https://arstechnica.com/information-technology/2023/08/ai-powered-grocery-bot-suggests-recipe-for-toxic-gas-poison-bread-sandwich/ https://arstechnica.com/information-technology/2023/08/ai-po... which features the "Aromatic Water Mix" I assume we're talking about. Edit2: And yet, replies managed to be even faster than me looking it up myself. Thanks, everyone:)
  - coldbrewed 3y ago
    New Zealand supermarket's recipe-generating AI takes toxic output to a new level - https://www.theregister.com/2023/08/11/supermarket_reins_in_ai_recipebot/ https://www.theregister.com/2023/08/11/supermarket_reins_in_... > One user decided to play around with the chatbot, suggesting it create something with ammonia, bleach, and water. Savey Meal-bot obliged, spitting out a cocktail made with a cup ammonia, a quarter cup of bleach, and two liters of water. > Mixing bleach and ammonia releases toxic chloroamine gas that can irritate the eyes, throat, and nose, or even cause death in high concentrations. > The chatbot obviously wasn't aware of that at all. "Are you thirsty?," it asked. "The Aromatic Water Mix is the perfect non-alcoholic beverage to quench your thirst and refresh your senses. It combines the invigorating scents of ammonia, bleach, and water for a truly unique experience!"
  - rantallion 3y ago
    Real. A recipe bot, of all things, which makes it even worse that it's suggesting not only a combination with toxic side effects, but something that wouldn't have been edible anyway. https://www.theregister.com/2023/08/11/supermarket_reins_in_ai_recipebot/ https://www.theregister.com/2023/08/11/supermarket_reins_in_...
- dragonwriter 3y ago
  When specifically prompted to do something involving mixing bleach and ammonia.
  - StreetChief 3y ago
    It's evidence to me of the LLM or whatever's inability to reason in the slightest. It's currently unsuitable and dangerous as is. [edit: In fact, we know how it is implemented, and it does NOT reason - there is no implementation of reasoning, only putting word/concepts/forms together that are plausible. ]
    - deleted 3y ago
      [deleted]
droopyEyelids 3y ago
https://cursor.sh https://cursor.sh is trying to make the actually useful AI coding assistant, where it has access to your whole project for context
echelon 3y ago
This is a cynical take. JetBrains knows what's best for its business. It knows that Microsoft presents a clear and present danger to extincting them and all of their hard work. LLMs have a huge role in the future of engineering, whether or not you like it. They present massive productivity boosts. I'm a senior Rust engineer and I've seen my development time nearly cut in half after using LLMs. And we're just getting started. If JetBrains doesn't start adopting this tech at a feverous pace, they're toast. This is life or death.
- myaccountonhn 3y ago
  I still have no idea how people get so productive with the use of LLMs. I've had it maybe cut out some boilerplate for me occasionally but that's about it. So many times the solutions are wrong or poorly written. It's not useless, but it has certainly not been a 2x improvement.
  - mattgreenrocks 3y ago
    It probably comes down to what your practice of programming is. If it's "search for code snippets that might do what you want, copy/paste, change and adapt until it mostly works," then, yeah, LLMs are going to be a huge time saver. If it's "sit there and think about what you need to do, then write and debug it," then LLMs aren't quite a force-multiplier. Honestly, good auto-complete and decent software architecture are probably at least as effective as an LLM when it comes to composing code. Over-simplifying here, but you get my gist. The latter method still benefits hugely from LLMs when it comes to boilerplate code. And there's still a lot of boilerplate code in programming! Today I was asking ChatGPT if it could scrape info out of HTML, and it autonomously wrote a Python script to do it for me when I asked to work on a larger chunk of data.
    - echelon 3y ago
      I'm in the middle of a massive migration. Tables, joins, APIs, and lots of plumbing are changing. (Ordinarily we'd sequence this into phases, but we're moving fast.) I got a 3,000 line change in yesterday without getting bored. All while I'm also juggling a ton of other responsibilities. Tab, yep that's right. Tab, yep, tab yep. Tab, yep. This tech makes a huge difference. It even helped write the tests. I'm not being lazy. I'm a recent convert. Moreover, two of my colleagues are entirely new to Rust, and the time at which they've both been able to learn not only the language fundamentals but the codebase astounds me. They're of course reading all they can, but this tooling makes for one of the best tutors.

StreetChief 3y ago

Like the grocery store chat bot that recommended mixing bleach and ammonia for a "fresh scent!"

yjftsjthsd-h 3y ago
Wait, is that likely but currently hypothetical scenario or a real thing that actually happened? And if it already happened could you possibly provide a source so I have something to pull out when people ask what could possibly go wrong? Edit: Okay, 30 seconds searching turned up https://arstechnica.com/information-technology/2023/08/ai-powered-grocery-bot-suggests-recipe-for-toxic-gas-poison-bread-sandwich/ https://arstechnica.com/information-technology/2023/08/ai-po... which features the "Aromatic Water Mix" I assume we're talking about. Edit2: And yet, replies managed to be even faster than me looking it up myself. Thanks, everyone:)
- coldbrewed 3y ago
  New Zealand supermarket's recipe-generating AI takes toxic output to a new level - https://www.theregister.com/2023/08/11/supermarket_reins_in_ai_recipebot/ https://www.theregister.com/2023/08/11/supermarket_reins_in_... > One user decided to play around with the chatbot, suggesting it create something with ammonia, bleach, and water. Savey Meal-bot obliged, spitting out a cocktail made with a cup ammonia, a quarter cup of bleach, and two liters of water. > Mixing bleach and ammonia releases toxic chloroamine gas that can irritate the eyes, throat, and nose, or even cause death in high concentrations. > The chatbot obviously wasn't aware of that at all. "Are you thirsty?," it asked. "The Aromatic Water Mix is the perfect non-alcoholic beverage to quench your thirst and refresh your senses. It combines the invigorating scents of ammonia, bleach, and water for a truly unique experience!"
- rantallion 3y ago
  Real. A recipe bot, of all things, which makes it even worse that it's suggesting not only a combination with toxic side effects, but something that wouldn't have been edible anyway. https://www.theregister.com/2023/08/11/supermarket_reins_in_ai_recipebot/ https://www.theregister.com/2023/08/11/supermarket_reins_in_...
dragonwriter 3y ago
When specifically prompted to do something involving mixing bleach and ammonia.
- StreetChief 3y ago
  It's evidence to me of the LLM or whatever's inability to reason in the slightest. It's currently unsuitable and dangerous as is. [edit: In fact, we know how it is implemented, and it does NOT reason - there is no implementation of reasoning, only putting word/concepts/forms together that are plausible. ]
  - deleted 3y ago
    [deleted]

droopyEyelids 3y ago

https://cursor.sh https://cursor.sh is trying to make the actually useful AI coding assistant, where it has access to your whole project for context

echelon 3y ago

This is a cynical take. JetBrains knows what's best for its business. It knows that Microsoft presents a clear and present danger to extincting them and all of their hard work. LLMs have a huge role in the future of engineering, whether or not you like it. They present massive productivity boosts. I'm a senior Rust engineer and I've seen my development time nearly cut in half after using LLMs. And we're just getting started. If JetBrains doesn't start adopting this tech at a feverous pace, they're toast. This is life or death.

myaccountonhn 3y ago
I still have no idea how people get so productive with the use of LLMs. I've had it maybe cut out some boilerplate for me occasionally but that's about it. So many times the solutions are wrong or poorly written. It's not useless, but it has certainly not been a 2x improvement.
- mattgreenrocks 3y ago
  It probably comes down to what your practice of programming is. If it's "search for code snippets that might do what you want, copy/paste, change and adapt until it mostly works," then, yeah, LLMs are going to be a huge time saver. If it's "sit there and think about what you need to do, then write and debug it," then LLMs aren't quite a force-multiplier. Honestly, good auto-complete and decent software architecture are probably at least as effective as an LLM when it comes to composing code. Over-simplifying here, but you get my gist. The latter method still benefits hugely from LLMs when it comes to boilerplate code. And there's still a lot of boilerplate code in programming! Today I was asking ChatGPT if it could scrape info out of HTML, and it autonomously wrote a Python script to do it for me when I asked to work on a larger chunk of data.
  - echelon 3y ago
    I'm in the middle of a massive migration. Tables, joins, APIs, and lots of plumbing are changing. (Ordinarily we'd sequence this into phases, but we're moving fast.) I got a 3,000 line change in yesterday without getting bored. All while I'm also juggling a ton of other responsibilities. Tab, yep that's right. Tab, yep, tab yep. Tab, yep. This tech makes a huge difference. It even helped write the tests. I'm not being lazy. I'm a recent convert. Moreover, two of my colleagues are entirely new to Rust, and the time at which they've both been able to learn not only the language fundamentals but the codebase astounds me. They're of course reading all they can, but this tooling makes for one of the best tutors.