3 ms·

It seems even more censored than OpenAI platforms which is a feat in itself.

refulgentis 3y ago
What does this mean, exactly? People say "censored" wayyy too much, I know what it means with goody2, but, people unexposed to base models seem to think there's a magical model that answers everything all the time.
- SketchySeaBeast 3y ago
  They mean they can't ask questions that the model deems sensitive. For instance, you (probably - haven't tried it myself) can't get ChatGPT to tell you how to make Meth.
  - imtringued 3y ago
    I saw a video where the LLM did tell you the ingredients.
- 123yawaworht456 3y ago
  a model without censorship and alignment is the opposite of 'magical'. openai/meta/anthropic/google spend a lot of time and money lobotomizing their models.
- gryn 3y ago
  here are two examples: - GPT4-V: I give it a SFW picture of a woman in bikini in the beach, there was nothing sexual about the photo. => oh no she has a big boobs and cleavage, must be porn. error response from the API because the guardrails block it. (funnily works with a woman with small boobs in the same scenario) - Gemini/Bard: tested it yesterday. ask it how to detect/fix (can't remember which) a memory leak, in general. => oh no I can't give you an answer you might use it for hacking. I had to go through multiple prompts and assure it that I'm the dev of the leaky app. the funniest thing is that it gave me an answer in Chinese when at no point did I use Chinese or allude to it. there are more cases I stumbled upon before by accident but these are the funniest that I could remember, esp the full chinese response out of nowhere, turn out they used some service from Baidu for their training according to some googling.
  - gtirloni 3y ago
    I'm getting concerned the AI Safety folks will cause the general population to make fun of LLMs and that will be hard to reverse. I also had the most stupid chats with Gemini this week due to its safety blocks. At no point I was asking it to say anything remotely "unsafe" even by AI Safety standards.
    - oohffyvfg 3y ago
      meh. that's sales strategy. early days of web search you had to pay to access x rated content. it's one of the reasons google rise was so fast, they didn't charge for that.
    - ametrau 3y ago
      Just to point it out again: AI safety means safe to our reputation.
- 7734128 3y ago
  I think goody2 is a good example of what people mean. It's like that, but just a bit less. Like raw Llama 2 refusing to write any code, because it might be used in a virus, or compare two fictional dwarven cities, because comparing cultures is inappropriate. (it refused 5/5 of my attempts at using the raw modell)
- raesene9 3y ago
  I agree it can be overused, but I've been running into more examples recently. One that springs to mind is that I asked GPT-4 to retrieve a webpage from the kubernetes docs site (the CVE list) and put some information from it into a markdown table so I could make some notes on it. It refused and when asked why responded :- "I'm unable to reproduce the list directly due to guidelines that prevent me from repeating unmodified content from web pages. My responses are designed to ensure that content creators' rights are respected and that information is shared in a way that encourages users to engage with the original sources for detailed and specific information." I could work around it in this case (download the JSON and tell it to parse that and make the table), but it does reduce the usefulness of these tools.
  - deleted 3y ago
    [deleted]

What does this mean, exactly? People say "censored" wayyy too much, I know what it means with goody2, but, people unexposed to base models seem to think there's a magical model that answers everything all the time.

SketchySeaBeast 3y ago
They mean they can't ask questions that the model deems sensitive. For instance, you (probably - haven't tried it myself) can't get ChatGPT to tell you how to make Meth.
- imtringued 3y ago
  I saw a video where the LLM did tell you the ingredients.
123yawaworht456 3y ago
a model without censorship and alignment is the opposite of 'magical'. openai/meta/anthropic/google spend a lot of time and money lobotomizing their models.
gryn 3y ago
here are two examples: - GPT4-V: I give it a SFW picture of a woman in bikini in the beach, there was nothing sexual about the photo. => oh no she has a big boobs and cleavage, must be porn. error response from the API because the guardrails block it. (funnily works with a woman with small boobs in the same scenario) - Gemini/Bard: tested it yesterday. ask it how to detect/fix (can't remember which) a memory leak, in general. => oh no I can't give you an answer you might use it for hacking. I had to go through multiple prompts and assure it that I'm the dev of the leaky app. the funniest thing is that it gave me an answer in Chinese when at no point did I use Chinese or allude to it. there are more cases I stumbled upon before by accident but these are the funniest that I could remember, esp the full chinese response out of nowhere, turn out they used some service from Baidu for their training according to some googling.
- gtirloni 3y ago
  I'm getting concerned the AI Safety folks will cause the general population to make fun of LLMs and that will be hard to reverse. I also had the most stupid chats with Gemini this week due to its safety blocks. At no point I was asking it to say anything remotely "unsafe" even by AI Safety standards.
  - oohffyvfg 3y ago
    meh. that's sales strategy. early days of web search you had to pay to access x rated content. it's one of the reasons google rise was so fast, they didn't charge for that.
  - ametrau 3y ago
    Just to point it out again: AI safety means safe to our reputation.
7734128 3y ago
I think goody2 is a good example of what people mean. It's like that, but just a bit less. Like raw Llama 2 refusing to write any code, because it might be used in a virus, or compare two fictional dwarven cities, because comparing cultures is inappropriate. (it refused 5/5 of my attempts at using the raw modell)
raesene9 3y ago
I agree it can be overused, but I've been running into more examples recently. One that springs to mind is that I asked GPT-4 to retrieve a webpage from the kubernetes docs site (the CVE list) and put some information from it into a markdown table so I could make some notes on it. It refused and when asked why responded :- "I'm unable to reproduce the list directly due to guidelines that prevent me from repeating unmodified content from web pages. My responses are designed to ensure that content creators' rights are respected and that information is shared in a way that encourages users to engage with the original sources for detailed and specific information." I could work around it in this case (download the JSON and tell it to parse that and make the table), but it does reduce the usefulness of these tools.
- deleted 3y ago
  [deleted]