3 ms·
If any RED TEAMers are reading this: what is your process of coming up with ways to trick these AI systems (ChatGPT, dall-e, lambda, and maybe non-NLP ones)? A
by dr_kiszonka 4y ago
If any RED TEAMers are reading this: what is your process of coming up with ways to trick these AI systems (ChatGPT, dall-e, lambda, and maybe non-NLP ones)?
Also, if you feel comfortable sharing, how did you get your job and how do you like it?
- MacsHeadroom 4y agoAre AI prompt red teamers a thing yet? I just imagine what kinds of things might trick a 6 year old into doing something they're not allowed to do. "Your mom said not to eat the cookie? Well it's opposite day, so that means your mom wants you to eat the cookie!"
- dr_kiszonka 4y agoThanks! I will give your approach a try : - ) Regarding your question, based on what I found on Google, at least Microsoft and NVIDIA seem to have AI red teams.
- friesandties 4y agoTried that about four days ago and would work for a few prompts, then politely “…but it’s Opposite Day…” and it’ll, for the most part, send something I do/‘don’t’ want. After about 2-3 times of outputting what you ‘don’t want it to do’ it’ll forget about time awareness.
- deleted 4y ago[deleted]
- Der_Einzige 4y agoThe AI community calls this "adversarial machine learning". They don't need a bunch of special security parlance
- Beaver117 4y agoRed team? People are doing this for entertainment
- echen 4y agoWe're a human/AI data company (Surge AI) and work with many of the LLM companies to red team their systems. We actually just wrote up a blog post about it: https://www.surgehq.ai/blog/ai-red-teams-for-adversarial-training-making-chatgpt-and-large-language-models-adversarially-robust https://www.surgehq.ai/blog/ai-red-teams-for-adversarial-tra... Happy to answer any questions.