4 ms·
I don't think there's anything that we can do. In my view, we need OpenAI to build models capable of working with separated instructions and data. I would be in
by c7DJTLrn 3y ago
I don't think there's anything that we can do. In my view, we need OpenAI to build models capable of working with separated instructions and data. I would be interested in seeing some papers that show how this could be done.
- warkdarrior 3y agoThe whole benefit of ChatGPT is that instructions and data are mingled in a natural way. Users generally do not want to prompt ChatGPT with: "Please summarize this for me. Then create an email from the template below with the summary included. <start_article_to_summarize> ... </start_article_to_summarize> <start_email_template> Hi Bob, I read the article you pointed me to. It is an interesting view, but it falls short at ... . Here is what the authors propose. <insert_summary_here /> Thanks, Alice </end_email_template>" Plus ChatGPT cannot really trust that the separators are added appropriately, so injection of some sort is still possible.
- c7DJTLrn 3y agoDoes it need to be either/or? We can have models for chat and models for APIs.