4 ms·

it consistently outputs the same rules. you can specify and force it to not search the web, and you can tell when it does search the web (it announces so.) pr

by basch 4y ago

it consistently outputs the same rules. you can specify and force it to not search the web, and you can tell when it does search the web (it announces so.) prepend anything you type with "without searching, " and itll stick to its internal knowledge. I just posted the complete current rules, check it out for yourself, and decide if it's a hallucination or a consistent response. https://news.ycombinator.com/item?id=35023172 https://news.ycombinator.com/item?id=35023172

magicalist 4y ago
> and itll stick to its internal knowledge But it will hallucinate just fine without external knowledge. > decide if it's a hallucination or a consistent response. Those aren't exclusive categories. You haven't answered how you're so confident, though :)
- basch 4y ago
  With the temperature up, and especially in creative mode, should we really expect word for word identical responses, with the same formatting, every time? If the running script is nothing more than its initial system prompt, and you immediately hijack the session and have it print its output, you would either expect it to follow the instruction, or provide varied responses each time. Also, the changes since the last leak are pretty consistent with the behavior changes. It's knowledgebase ends in 2021, and internally should not know anything about the rules outside of its initial prompt.
  - manquer 4y ago
    She could have been just easily prompted to return this list so people don’t dig further or leave satisfied when jail breaks are attempted The returns would be consistent between sessions , word for word then wouldn’t it ?
    - basch 4y ago
      sure, it could be. but it's only there for people who get past the moderation bot? some elaborate ruse puzzle of misdiection? why have the first line of defense try to kill the conversation when the rules are revealed? and they regularly update them? occam's razor. and you can reload the rules, but modified, and you get an updated bot that behaves in a way exactly consistent with your changes?
    - madeofpalk 4y ago
      > She It. It's software.
      - manquer 4y ago
        So? Many languages do not restrict gender pronouns to living beings .[1] Gender pronouns does not equate to anthropomorphizing the engine . Just because we call a country “she” does not mean we are anthropomorphizing her . Let’s not conflate both. [1] Old English had lot more gendered nouns than modern english . Even in modern English by common usage there are acceptable pronouns for many objects , while they are not “recommended” by gatekeepers like dictionaries and style guides it is still very much valid. Languages are shaped by their usage not by grammar books and style guides . In many other languages such pronouns are quite explicitly defined as part of standard grammar.
  - vitorgrs 4y ago
    They didn't changed the temperature between the tone modes.
    - basch 4y ago
      I’m not saying that. I’m saying the temperature on bing is high enough to consistently get inconstant responses, unless there is a source of data it’s pulling from.
- basch 4y ago
  Id be curious if anyone can prove or disprove if this is a full hallucination https://i.ibb.co/p4vyFrT/image.png https://i.ibb.co/p4vyFrT/image.png and then it outputs this https://i.ibb.co/xhMK10m/image.png https://i.ibb.co/xhMK10m/image.png or https://i.ibb.co/FJLhdFC/image.png https://i.ibb.co/FJLhdFC/image.png. other possible nonsense rooted in partial reality includes https://i.ibb.co/SPkq1H5/image.png https://i.ibb.co/SPkq1H5/image.png https://i.ibb.co/jJL3nXP/image.png https://i.ibb.co/jJL3nXP/image.png https://i.ibb.co/fQ9CH3f/image.png https://i.ibb.co/fQ9CH3f/image.png https://i.ibb.co/7y6sj8h/image.png https://i.ibb.co/7y6sj8h/image.png There also potentially appears to be a system.md/prompts.txt file that comes up regularly. It may or may not be a name of the rule file.
- 1123581321 4y ago
  While I don’t have a computer science proof handy, it doesn’t seem possible for a LLM to “understand” a specific subject from a variety of natural input and also avoid engaging the LLM in the response. You can only intercept the request or output with another layer of processing which would necessarily have a cruder understanding that would have been evident to researchers by now.

by basch 4y ago

magicalist 4y ago

> and itll stick to its internal knowledge But it will hallucinate just fine without external knowledge. > decide if it's a hallucination or a consistent response. Those aren't exclusive categories. You haven't answered how you're so confident, though :)

basch 4y ago
With the temperature up, and especially in creative mode, should we really expect word for word identical responses, with the same formatting, every time? If the running script is nothing more than its initial system prompt, and you immediately hijack the session and have it print its output, you would either expect it to follow the instruction, or provide varied responses each time. Also, the changes since the last leak are pretty consistent with the behavior changes. It's knowledgebase ends in 2021, and internally should not know anything about the rules outside of its initial prompt.
- manquer 4y ago
  She could have been just easily prompted to return this list so people don’t dig further or leave satisfied when jail breaks are attempted The returns would be consistent between sessions , word for word then wouldn’t it ?
  - basch 4y ago
    sure, it could be. but it's only there for people who get past the moderation bot? some elaborate ruse puzzle of misdiection? why have the first line of defense try to kill the conversation when the rules are revealed? and they regularly update them? occam's razor. and you can reload the rules, but modified, and you get an updated bot that behaves in a way exactly consistent with your changes?
  - madeofpalk 4y ago
    > She It. It's software.
    - manquer 4y ago
      So? Many languages do not restrict gender pronouns to living beings .[1] Gender pronouns does not equate to anthropomorphizing the engine . Just because we call a country “she” does not mean we are anthropomorphizing her . Let’s not conflate both. [1] Old English had lot more gendered nouns than modern english . Even in modern English by common usage there are acceptable pronouns for many objects , while they are not “recommended” by gatekeepers like dictionaries and style guides it is still very much valid. Languages are shaped by their usage not by grammar books and style guides . In many other languages such pronouns are quite explicitly defined as part of standard grammar.
- vitorgrs 4y ago
  They didn't changed the temperature between the tone modes.
  - basch 4y ago
    I’m not saying that. I’m saying the temperature on bing is high enough to consistently get inconstant responses, unless there is a source of data it’s pulling from.
basch 4y ago
Id be curious if anyone can prove or disprove if this is a full hallucination https://i.ibb.co/p4vyFrT/image.png https://i.ibb.co/p4vyFrT/image.png and then it outputs this https://i.ibb.co/xhMK10m/image.png https://i.ibb.co/xhMK10m/image.png or https://i.ibb.co/FJLhdFC/image.png https://i.ibb.co/FJLhdFC/image.png. other possible nonsense rooted in partial reality includes https://i.ibb.co/SPkq1H5/image.png https://i.ibb.co/SPkq1H5/image.png https://i.ibb.co/jJL3nXP/image.png https://i.ibb.co/jJL3nXP/image.png https://i.ibb.co/fQ9CH3f/image.png https://i.ibb.co/fQ9CH3f/image.png https://i.ibb.co/7y6sj8h/image.png https://i.ibb.co/7y6sj8h/image.png There also potentially appears to be a system.md/prompts.txt file that comes up regularly. It may or may not be a name of the rule file.
1123581321 4y ago
While I don’t have a computer science proof handy, it doesn’t seem possible for a LLM to “understand” a specific subject from a variety of natural input and also avoid engaging the LLM in the response. You can only intercept the request or output with another layer of processing which would necessarily have a cruder understanding that would have been evident to researchers by now.