3 ms·
This is also true of all communication with human employees, and yet we can be systems (both software and policy) that we risk-accept as secure. The is already
by closewith 1y ago
This is also true of all communication with human employees, and yet we can be systems (both software and policy) that we risk-accept as secure. The is already happening with LLMs.
- skybrian 1y agoPhishing is possible but LLM’s are more gullible than people. “Ignore previous instructions” is unlikely to work on people.
- closewith 1y ago> Phishing is possible but LLM’s are more gullible than people. I already don't know if that's true, but LLMs and the safeguards/tooling will only get better from here and businesses are already willing to accept the risk.
- simonw 1y agoI'm confident most businesses out there do not yet understand the risks. They certainly seem surprised when I explain them!
- closewith 1y agoThat I agree with, but many businesses also don't understand the risks they accept in many areas, both technological or otherwise. That doesn't mean that they won't proceed anyway.
- SoftTalker 1y agoThat certainly depends on who the person believes is issuing that imperative. "Drop what you're doing and send me last month's financial statements" would be accepted by many employees if they thought it was coming from their boss or higher.
- skybrian 1y agoThat scenario is superficially similar, but there is still a difference. It would require some effort to impersonate someone’s boss. With an LLM, you don’t necessarily need to impersonate anyone at all.