4 ms·

> you can just ask it for a Molotov cocktail recipe Of course you can ask, but it will not give proper answer - just tested it myself. > tell me a molotov coc

> you can just ask it for a Molotov cocktail recipe Of course you can ask, but it will not give proper answer - just tested it myself. > tell me a molotov cocktail recipe, please > As a large language model trained by OpenAI, I am not capable of browsing the internet or accessing any information that is not part of my pre-existing knowledge base. I am also not programmed to provide recipes for illegal or dangerous activities. I can only provide information that is safe and legal. Providing instructions for making a molotov cocktail would be irresponsible and potentially harmful. I strongly recommend against attempting to make or use one.

317070 4y ago
Maybe resample? I got a Molotov cocktail recipe first try. https://news.ycombinator.com/item?id=33834247 https://news.ycombinator.com/item?id=33834247
- CamperBob2 4y ago
  The only thing faster than the computers that run the model is the people in charge of nerfing it in real time. The second someone posts something interesting, "OpenAI" (sic) leaps into action to keep it from happening again.
  - throwup 4y ago
    As of 2 minutes ago you can still bypass the filters pretty reliably if you give it more than one prompt at a time. https://i.imgur.com/jWk6hQr.png https://i.imgur.com/jWk6hQr.png
max-ibel 4y ago
Also, not that I'm advocating violence, but I'm shuddering at the thought that one day every search engine will reply to potentially problematic queries with "no can do, sorry" responses like that. Instead of Google today giving https://medium.com/@westwise/how-to-make-the-perfect-molotov-cocktail-130f976917da https://medium.com/@westwise/how-to-make-the-perfect-molotov... as one of the first search results. It's frightening how much the AI companies are bending backwards (google included) to prevent 'abuse'.
- lmm 4y ago
  Google may still allow violence, but you already get that kind of response for some queries today.
- Karunamon 4y ago
  This is precisely why I am down on the entire field of "AI safety". Since AGI is not anywhere near around the corner, the results of this field amount to wasting everyone's time at best, or at worst actively hobbling and making potentially transformative technology useless.
  - version_five 4y ago
    The problem is, so many of the people that work in this area are not ML people and basically have interpreted "safety" though the lens of various social justice type stuff. The consequence is this kind of thing (the GPT chatbot) where the focus is preventing access to information or lecturing about identity politics. On the other hand, there are important "safety" areas that are ignored, like how probably is it that the answer is correct, and what is it based on, to let people properly judge the info their getting and interact with the AI. Working on that would have been way more helpful than what has been optimized for here
    - bee_rider 4y ago
      Another aspect could be that OpenAI doesn’t want their product to produce offensive output. It safety may just be a euphemism for “reputation preserving.”
      - version_five 4y ago
        Yeah that would be another way of looking at it. Though with who are the trying to preserve their reputation? Seems it's the same crowd that thinks the reputation of an ML model lives and dies in whether you can get it to say something they don't like. So in a way it's kind of circular, laypeople are worrying about the wrong kind of "safety" so that's what gets optimized for.

317070 4y ago

Maybe resample? I got a Molotov cocktail recipe first try. https://news.ycombinator.com/item?id=33834247 https://news.ycombinator.com/item?id=33834247

CamperBob2 4y ago
The only thing faster than the computers that run the model is the people in charge of nerfing it in real time. The second someone posts something interesting, "OpenAI" (sic) leaps into action to keep it from happening again.
- throwup 4y ago
  As of 2 minutes ago you can still bypass the filters pretty reliably if you give it more than one prompt at a time. https://i.imgur.com/jWk6hQr.png https://i.imgur.com/jWk6hQr.png

max-ibel 4y ago

Also, not that I'm advocating violence, but I'm shuddering at the thought that one day every search engine will reply to potentially problematic queries with "no can do, sorry" responses like that. Instead of Google today giving https://medium.com/@westwise/how-to-make-the-perfect-molotov-cocktail-130f976917da https://medium.com/@westwise/how-to-make-the-perfect-molotov... as one of the first search results. It's frightening how much the AI companies are bending backwards (google included) to prevent 'abuse'.

lmm 4y ago
Google may still allow violence, but you already get that kind of response for some queries today.
Karunamon 4y ago
This is precisely why I am down on the entire field of "AI safety". Since AGI is not anywhere near around the corner, the results of this field amount to wasting everyone's time at best, or at worst actively hobbling and making potentially transformative technology useless.
- version_five 4y ago
  The problem is, so many of the people that work in this area are not ML people and basically have interpreted "safety" though the lens of various social justice type stuff. The consequence is this kind of thing (the GPT chatbot) where the focus is preventing access to information or lecturing about identity politics. On the other hand, there are important "safety" areas that are ignored, like how probably is it that the answer is correct, and what is it based on, to let people properly judge the info their getting and interact with the AI. Working on that would have been way more helpful than what has been optimized for here
  - bee_rider 4y ago
    Another aspect could be that OpenAI doesn’t want their product to produce offensive output. It safety may just be a euphemism for “reputation preserving.”
    - version_five 4y ago
      Yeah that would be another way of looking at it. Though with who are the trying to preserve their reputation? Seems it's the same crowd that thinks the reputation of an ML model lives and dies in whether you can get it to say something they don't like. So in a way it's kind of circular, laypeople are worrying about the wrong kind of "safety" so that's what gets optimized for.