3 ms·
This is essentially prompt hacking. It is interesting to see that ChatGPT weighs the system prompt so heavily, allowing it to ignore the contents of the PDF.
by xeckr 3y ago
This is essentially prompt hacking. It is interesting to see that ChatGPT weighs the system prompt so heavily, allowing it to ignore the contents of the PDF.
- spdustin 3y agoThe processing of the content in the PDF happens outside the context of the chat itself. The only prompt I've been able to get from that directly is just the auto-generated URL used by the headless browser that reads the file.
- stevenhuang 3y agoThis isn't particularly new or novel. It's been known for a while there's no way to effectively sandbox instructions from data if it gets fed into an LLM's context.