8 ms·
> LLM would act as the only person/thing making a refund judgement based on only user input? > Easy answer is two LLMs. I think the easier answer is add a hum
by skissane 3y ago
> LLM would act as the only person/thing making a refund judgement based on only user input?
> Easy answer is two LLMs.
I think the easier answer is add a human to the loop. Instead of employees having to reply to customer emails themselves... the LLM drafts a reply, which the employee then has to review, with the opportunity to modify it before sending, or choose not to send it all.
Reviewing proposed replies from an LLM is still likely to be less work than writing the reply by hand, so the employee can get through more emails than they would with manual replying. It may also have other benefits, such as a more consistent communication style.
Even if the customer commits a prompt injection attack, hopefully the employee notices it and refuses to send that reply.
- simonw 3y agoYeah, human in the loop is one of the best options we have for many potential prompt injection problems at the moment. (Aside from prompt injection, I think putting a human in the loop before sending a message for other people to read is good manners anyway.)