3 ms·
OP is demonstrating that the product follows prompts from the pages it visits, not just from it's owner in the UI that controls it. To be fair, this is a beta
by cloudking 2y ago
OP is demonstrating that the product follows prompts from the pages it visits, not just from it's owner in the UI that controls it.
To be fair, this is a beta product and is likely ridden with bugs. I think OP is trying to make a point that LLM powered applications can be potentially tricked into behaving in ways that are unintended, and the "bug fixes" may be a constant catch up game for developers fighting an infinite pool of edge cases.
- crooked-v 2y agoSaying 'tricked' is understating it. The example is Claude following instructions from a plain sentence in the web page content. There's no trickery at all, just a tool that's fundamentally unsuited for purpose.
- roywiggins 2y agoFor an LLM to read a screen, it has to be provided the screen as part of its prompt, and it will be vulnerable to prompt injections if any part of that screen contains untrusted data.