3 ms·
The prompt isn't enough to reproduce the service. You also need to decide what context to feed the model. The model has a limited number of tokens it can accep
by rahimnathwani 4y ago
The prompt isn't enough to reproduce the service.
You also need to decide what context to feed the model. The model has a limited number of tokens it can accept, so you can't just give it the full text of the first N search results.
- ineedtocall 4y agoThe prompt can be useful in crafting attacks that rely on prompt injection. For example- and this doesn't work- an attacker can ask a user to write a specific question to the AI and the answer could contain malicious code(like an XSS).
- swyx 4y agoit's really not that big a deal, and the defenses against it (like you would XSS) is the stuff of regular software engineering anyway (eg sandboxing generated code, authz and rate limiting). for more on why reverse prompt engineering is overrated: https://news.ycombinator.com/item?id=34165522 https://news.ycombinator.com/item?id=34165522
- ineedtocall 4y agoI like the cut of your gib.