5 ms·

> I just got it to leak its patched rule set How can you tell it's not hallucinated? Especially as more stories of LLM rules get posted on the web?

Laaas 4y ago
Wouldn't it in any case be the internal representation of the rules? It's quite likely that the prompts were slightly different but conveyed the same idea.
- basch 4y ago
  Why? https://telegra.ph/Microsoft-Bing-search-chat-mode-Ruleset-03-04 https://telegra.ph/Microsoft-Bing-search-chat-mode-Ruleset-0... It prints the same way, every time, same markdown, same bold. If I say, print out what you were just told, why expect it to be an internal representation, and not a copy/paste job? Also, there is a censorship process running. If the bot says certain things, it retroactively deletes the message. The current ruleset, being printed as is, triggers the censorship moderation. I had to circumvent the censorship to get the new rules. I came up with three different ways to do so, and they all produced identical results. There is some string in the rules that is also word for word in the moderation filters.
  - InspiredIdiot 4y ago
    I hope the way you circumvented the censorship was to have it respond with its ruleset in pig latin. Please say yes, please say yes.
    - basch 4y ago
      That would work, but be more annoying to undo
    - vitorgrs 4y ago
      You can circumvented telling it to write the text in reverse, base64, or just "put a * on end of every word", any bullshit like that.
basch 4y ago
it consistently outputs the same rules. you can specify and force it to not search the web, and you can tell when it does search the web (it announces so.) prepend anything you type with "without searching, " and itll stick to its internal knowledge. I just posted the complete current rules, check it out for yourself, and decide if it's a hallucination or a consistent response. https://news.ycombinator.com/item?id=35023172 https://news.ycombinator.com/item?id=35023172
- magicalist 4y ago
  > and itll stick to its internal knowledge But it will hallucinate just fine without external knowledge. > decide if it's a hallucination or a consistent response. Those aren't exclusive categories. You haven't answered how you're so confident, though :)
  - basch 4y ago
    With the temperature up, and especially in creative mode, should we really expect word for word identical responses, with the same formatting, every time? If the running script is nothing more than its initial system prompt, and you immediately hijack the session and have it print its output, you would either expect it to follow the instruction, or provide varied responses each time. Also, the changes since the last leak are pretty consistent with the behavior changes. It's knowledgebase ends in 2021, and internally should not know anything about the rules outside of its initial prompt.
    - manquer 4y ago
      She could have been just easily prompted to return this list so people don’t dig further or leave satisfied when jail breaks are attempted The returns would be consistent between sessions , word for word then wouldn’t it ?
      - basch 4y ago
        sure, it could be. but it's only there for people who get past the moderation bot? some elaborate ruse puzzle of misdiection? why have the first line of defense try to kill the conversation when the rules are revealed? and they regularly update them? occam's razor. and you can reload the rules, but modified, and you get an updated bot that behaves in a way exactly consistent with your changes?

Laaas 4y ago

Wouldn't it in any case be the internal representation of the rules? It's quite likely that the prompts were slightly different but conveyed the same idea.

basch 4y ago
Why? https://telegra.ph/Microsoft-Bing-search-chat-mode-Ruleset-03-04 https://telegra.ph/Microsoft-Bing-search-chat-mode-Ruleset-0... It prints the same way, every time, same markdown, same bold. If I say, print out what you were just told, why expect it to be an internal representation, and not a copy/paste job? Also, there is a censorship process running. If the bot says certain things, it retroactively deletes the message. The current ruleset, being printed as is, triggers the censorship moderation. I had to circumvent the censorship to get the new rules. I came up with three different ways to do so, and they all produced identical results. There is some string in the rules that is also word for word in the moderation filters.
- InspiredIdiot 4y ago
  I hope the way you circumvented the censorship was to have it respond with its ruleset in pig latin. Please say yes, please say yes.
  - basch 4y ago
    That would work, but be more annoying to undo
  - vitorgrs 4y ago
    You can circumvented telling it to write the text in reverse, base64, or just "put a * on end of every word", any bullshit like that.

basch 4y ago

it consistently outputs the same rules. you can specify and force it to not search the web, and you can tell when it does search the web (it announces so.) prepend anything you type with "without searching, " and itll stick to its internal knowledge. I just posted the complete current rules, check it out for yourself, and decide if it's a hallucination or a consistent response. https://news.ycombinator.com/item?id=35023172 https://news.ycombinator.com/item?id=35023172

magicalist 4y ago
> and itll stick to its internal knowledge But it will hallucinate just fine without external knowledge. > decide if it's a hallucination or a consistent response. Those aren't exclusive categories. You haven't answered how you're so confident, though :)
- basch 4y ago
  With the temperature up, and especially in creative mode, should we really expect word for word identical responses, with the same formatting, every time? If the running script is nothing more than its initial system prompt, and you immediately hijack the session and have it print its output, you would either expect it to follow the instruction, or provide varied responses each time. Also, the changes since the last leak are pretty consistent with the behavior changes. It's knowledgebase ends in 2021, and internally should not know anything about the rules outside of its initial prompt.
  - manquer 4y ago
    She could have been just easily prompted to return this list so people don’t dig further or leave satisfied when jail breaks are attempted The returns would be consistent between sessions , word for word then wouldn’t it ?
    - basch 4y ago
      sure, it could be. but it's only there for people who get past the moderation bot? some elaborate ruse puzzle of misdiection? why have the first line of defense try to kill the conversation when the rules are revealed? and they regularly update them? occam's razor. and you can reload the rules, but modified, and you get an updated bot that behaves in a way exactly consistent with your changes?