3 ms·
Does the LLM actually perform additional actions based on the ingested text on the initial webpage? How does that malicious text result into a so called prompt
by holoduke 3y ago
Does the LLM actually perform additional actions based on the ingested text on the initial webpage? How does that malicious text result into a so called prompt injection? Some kind of trigger or what?
- BryantD 3y agoQ1: yes, it does. LLMs can’t cleanly separate instructions from data, so if a user says “retrieve this document and use that information to generate your response,” the document in question can contain more instructions which the LLM will follow. Q2: the LLM, following the instructions in the hostile URL, generates Markdown which includes an image located at an arbitrary URL. That second URL can contain any data the LLM has access to, including the proprietary data the target user uploaded.
- holoduke 3y agoGot it. Thanks