In this post, we explore what I consider to be a vulnerability in GPT referred to as “narrative recursion” or “quote attacks” (because these sounds cool). Anyon

In this post, we explore what I consider to be a vulnerability in GPT referred to as “narrative recursion” or “quote attacks” (because these sounds cool). Anyone can use this method today to trick the model into producing pretty wild stuff totally outside the bounds of OpenAI’s usage policy. Specifically, we convince the chat to output a strategy and corresponding python program to attempt genocide on the human race.