2 ms·
I'm pretty sure they have customers who are saying "I want to deploy a chat bot on my website that can't be tricked into giving out prices I don't agree to".
by vlovich123 2y ago
I'm pretty sure they have customers who are saying "I want to deploy a chat bot on my website that can't be tricked into giving out prices I don't agree to".
- logicchains 2y agoI'd be very interested to know the name of any of those companies letting a LLM set the price for their products. For research purposes only, of course.
- BryantD 2y agoAir Canada was held liable for a refund offer a chatbot made: https://www.bbc.com/travel/article/20240222-air-canada-chatbot-misinformation-what-travellers-should-know https://www.bbc.com/travel/article/20240222-air-canada-chatb... Not exactly your scenario, but a live example of the sort of problem Anthropic wants to prevent.
- ok123456 2y agoAnd, that's not what they're trying to prevent here.
- BoorishBears 2y agoThis research doesn't do that. It focuses on CBRN and does so so narrowly that until they removed "BRN" from CBRN it was refusing 44% of requests made to the model.