The whole benefit of ChatGPT is that instructions and data are mingled in a natural way. Users generally do not want to prompt ChatGPT with: "Please summariz

The whole benefit of ChatGPT is that instructions and data are mingled in a natural way. Users generally do not want to prompt ChatGPT with: "Please summarize this for me. Then create an email from the template below with the summary included. <start_article_to_summarize> ... </start_article_to_summarize> <start_email_template> Hi Bob, I read the article you pointed me to. It is an interesting view, but it falls short at ... . Here is what the authors propose. <insert_summary_here /> Thanks, Alice </end_email_template>" Plus ChatGPT cannot really trust that the separators are added appropriately, so injection of some sort is still possible.