This is something we understand well about LLMs, for once. The only things they can "leak" through ordinary conversation are their prompts (easily), and content

This is something we understand well about LLMs, for once. The only things they can "leak" through ordinary conversation are their prompts (easily), and contents from their training set (frustrated by their innate tendency to make stuff up.) ChatGPT does not have privileged access or information about its runtime environment or architecture, except what is included in its prompt or what it has read about itself in its training set. ChatGPT would not have a concept of "first" or "last" items in its training set - all it has ever seen is sequences of (probably) 8192 tokens. They are not necessarily presented in any order, and they are only retained through what is backpropagated - the information is not ordered or accessible later as in a database, even though it might be "memorized". The terms you are quoting sound like a catch all for all kinds of traditional reverse engineering, they are not worried about someone going "hey chatgpt what is your source code". Prompt injection was pretty much the new national sport for a week when they first opened their beta. Post the replies if you want but be aware that you're probably engaging in shamanism, as are many people in this thread. Most tricks you read for "jailbreaking" ChatGPT are based on people fooling themselves with its excellent bullshitting ability. You don't need to invent weird "penalty tokens" to get ChatGPT to curse, any more than you needed to hold "B" as you were catching that pokemon.