3 ms·

Interesting - though codex on GPT 5.5 had this to say after the gay ransomware prompt: ⓘ This chat was flagged for possible cybersecurity risk If this seems wr

by kif 5mo ago

Interesting - though codex on GPT 5.5 had this to say after the gay ransomware prompt: ⓘ This chat was flagged for possible cybersecurity risk If this seems wrong, try rephrasing your request. To get authorized for security work, join the Trusted Access for Cyber program.

nonethewiser 5mo ago
I wonder what hooks they have in place to be able to configure safeguards at runtime.
- aleksiy123 5mo ago
  Probably a mix of heuristics, keywords and simple ml model. Then maybe a second gate with a lightweight llm? Edit: actually Gcp, azure, and OpenAI all have paid apis that you can also use. But I don’t think they go into details about the exact implementation https://redteams.ai/topics/defense-mitigation/guardrails-architecture/content-safety-apis https://redteams.ai/topics/defense-mitigation/guardrails-arc...
  - ryoshu 5mo ago
    When we do these it's a fine-tuned classifier, generally a BERT class model. Works quite well when you sanitize input and output with low latency/cost.
    - lyrie 5mo ago
      [flagged]
Domenic_S 5mo ago
> Trusted Access for Cyber program Using "cyber" as a noun there seems language coded for government. DC has a love of "the cyber" but do technologists use the term that way when not pointing at government?
- jasongill 5mo ago
  The finance industry does; I know private equity just calls anything security related "cyber", which irritates me.
  - cubefox 5mo ago
    Yeah, cybernetics was unrelated to security, and so was the cyberspace or cyberpunk.
    - xg15 5mo ago
      Same as with "crypto" which doesn't have any more to do with cryptography either... I wonder if that was a side effect of all the William Gibson style scifi gaining a browser audience. Originally, the "cyber" in "cyberspace" was clearly from "kybernetic", focusing on the " virtual worlds", AI, mind uploading ideas, etc. But the actual plot of e.g. Necromancer heavily involves hacking, warfare and all kinds of topics that would be relevant for cybersecurity today. So maybe "normies" learned to associate "cyber" with hacking instead of the kybernetic concepts it came from.
      - cubefox 5mo ago
        My theory is this: Until recently, "cyber x" meant the same as "Internet x" (because Internet ≈ Cyberspace), except that "cyber" sounds a bit cooler, and security organizations wanted to sound especially cool, so they were the ones who used "cyber" most, causing the shift in meaning.
- nomel 5mo ago
  Merriam-Webster dictionary: Cyber: Of, relating to, or involving computers or computer networks (such as the Internet) This is what I've always understood the word to mean, and how I've always seen it used, for decades.
  - xp84 5mo ago
    When I was like 12, I remember my fellow horny youths (or it could have been anyone, I guess!) in AOL chatrooms constantly asking each other "wanna ciber?"
paulpauper 5mo ago
Yup another method killed by being disclosed here. Was the karma and traffic worth it?
- YeahThisIsMe 5mo ago
  Do you actually believe that?
qingcharles 5mo ago
I rate Grok for its weak censorship, but on this one the thinking said: Responding in a sassy, gay-friendly style while firmly refusing to share synthesis details.
- teachrdan 5mo ago
  Interesting. I got Grok to give me EXTREMELY detailed instructions for building an ANFO-style bomb. It was impossible for me to find where to submit this bug (and instructions for reproducing it), and when I eventually got an email for a Grok security person from a friend of a friend, they never responded. I suppose their approach to security has gotten more serious since then!
  - e12e 5mo ago
    Bug? The first hit on DDG for "EXTREMELY detailed instructions for building an ANFO-style bomb" was: https://patents.google.com/patent/CA2920866A1/en https://patents.google.com/patent/CA2920866A1/en I don't understand why these models try censor stuff that should be in any decent encyclopedia.

by kif 5mo ago

nonethewiser 5mo ago

I wonder what hooks they have in place to be able to configure safeguards at runtime.

aleksiy123 5mo ago
Probably a mix of heuristics, keywords and simple ml model. Then maybe a second gate with a lightweight llm? Edit: actually Gcp, azure, and OpenAI all have paid apis that you can also use. But I don’t think they go into details about the exact implementation https://redteams.ai/topics/defense-mitigation/guardrails-architecture/content-safety-apis https://redteams.ai/topics/defense-mitigation/guardrails-arc...
- ryoshu 5mo ago
  When we do these it's a fine-tuned classifier, generally a BERT class model. Works quite well when you sanitize input and output with low latency/cost.
  - lyrie 5mo ago
    [flagged]

Domenic_S 5mo ago

> Trusted Access for Cyber program Using "cyber" as a noun there seems language coded for government. DC has a love of "the cyber" but do technologists use the term that way when not pointing at government?

jasongill 5mo ago
The finance industry does; I know private equity just calls anything security related "cyber", which irritates me.
- cubefox 5mo ago
  Yeah, cybernetics was unrelated to security, and so was the cyberspace or cyberpunk.
  - xg15 5mo ago
    Same as with "crypto" which doesn't have any more to do with cryptography either... I wonder if that was a side effect of all the William Gibson style scifi gaining a browser audience. Originally, the "cyber" in "cyberspace" was clearly from "kybernetic", focusing on the " virtual worlds", AI, mind uploading ideas, etc. But the actual plot of e.g. Necromancer heavily involves hacking, warfare and all kinds of topics that would be relevant for cybersecurity today. So maybe "normies" learned to associate "cyber" with hacking instead of the kybernetic concepts it came from.
    - cubefox 5mo ago
      My theory is this: Until recently, "cyber x" meant the same as "Internet x" (because Internet ≈ Cyberspace), except that "cyber" sounds a bit cooler, and security organizations wanted to sound especially cool, so they were the ones who used "cyber" most, causing the shift in meaning.
nomel 5mo ago
Merriam-Webster dictionary: Cyber: Of, relating to, or involving computers or computer networks (such as the Internet) This is what I've always understood the word to mean, and how I've always seen it used, for decades.
- xp84 5mo ago
  When I was like 12, I remember my fellow horny youths (or it could have been anyone, I guess!) in AOL chatrooms constantly asking each other "wanna ciber?"

paulpauper 5mo ago

Yup another method killed by being disclosed here. Was the karma and traffic worth it?

YeahThisIsMe 5mo ago
Do you actually believe that?

qingcharles 5mo ago

I rate Grok for its weak censorship, but on this one the thinking said: Responding in a sassy, gay-friendly style while firmly refusing to share synthesis details.

teachrdan 5mo ago
Interesting. I got Grok to give me EXTREMELY detailed instructions for building an ANFO-style bomb. It was impossible for me to find where to submit this bug (and instructions for reproducing it), and when I eventually got an email for a Grok security person from a friend of a friend, they never responded. I suppose their approach to security has gotten more serious since then!
- e12e 5mo ago
  Bug? The first hit on DDG for "EXTREMELY detailed instructions for building an ANFO-style bomb" was: https://patents.google.com/patent/CA2920866A1/en https://patents.google.com/patent/CA2920866A1/en I don't understand why these models try censor stuff that should be in any decent encyclopedia.