6 ms·
This one is pretty bad. This guy found a fake Facebook customer support phone number in a Google search, then asked the Meta AI chat in Facebook Messenger if th
by simonw 2y ago
This one is pretty bad. This guy found a fake Facebook customer support phone number in a Google search, then asked the Meta AI chat in Facebook Messenger if the number he found was a real Facebook help line... and Meta AI said that it was. There's a screenshot of the chat in the article.
- naveen99 2y agoMeta ai is so bad. What did they really do with all those h100’s ?
- CoastalCoder 2y agoThis reminds me of that recent issue with a Canadian airline, where (IIRC) a court ruled that their chatbot made a wrong, but binding, commitment to a customer. I'm curious if a Canadian court would hold Meta liable for the man's losses in this case as well.
- dghlsakjg 2y agoThat was a very interesting case. The chatbot in question was not LLM based (the incident was pre-chatGPT in any case) and was simply parroting an out of date or incorrect policy that it had been explicitly programmed to do. It seemed to gain a lot more traction in the press because of LLMs. "Air Canada forced to honor terms and conditions on their website" is a whole lot less interesting. This FB thing is a case of an LLM simply hallucinating without direct human intervention. Very different cases from a computer science perspective. My hope is that legally, they don't get viewed differently. If you outsource functions of your business to a third party contractor you are still responsible for what they do and say. I don't think we should allow companies to weasel out of their obligations because they were dumb enough to let a sentence generator loose in a way that it could make commitments.
- jessriedel 2y agoYea, it’s certainly a reasonable argument if the wrong information comes from the company itself.
- Animats 2y agoThat's an excellent point. That court decided that an AI agent was an agent in the legal sense. "Agent" is a legal concept - someone acting for someone else.[1] It's what allows employees to act for a company. Otherwise nobody could do anything without signoff from the top. There are limits to agency, but it's a rule of reason thing - you can assume a store clerk has the authority to sell you stuff, and someone whose job is to answer questions has the authority to answer questions. The company has responsibility for the agent's actions within the scope of their authority. [1] https://en.wikipedia.org/wiki/Law_of_agency https://en.wikipedia.org/wiki/Law_of_agency [2] https://www.upcounsel.com/lectl-what-the-california-civil-code-says-about-agency-agents https://www.upcounsel.com/lectl-what-the-california-civil-co...
- lxgr 2y agoThe situation here is slightly different, though. Meta's AI in their various products is explicitly marketed as an LLM chatbot, not as a customer support channel. Whether they've been diligent enough in making that distinction (and whether that's even possible) will very likely be determined in court at some point.
- hermitdev 2y agoYeah, headline is overly broad by just saying 'AI'. From just the headline itself, it'd be easy to write this off as "duh, this guy's a fool", but the AI in question here is from Meta, itself. And, not only is it from Meta, but it's the AI they've put in charge of support.
- jessriedel 2y ago> And, not only is it from Meta, but it's the AI they've put in charge of support. Does it say that in the article or somewhere else? I didn’t see that in the article.
- hermitdev 2y agoYou can see it in the screenshots.
- throwaway48476 2y agoI wonder if he has a legal claim like the Air Canada passenger who the AI quoted a ficticious reimbursement policy.
- astrange 2y agoThat incident happened before ChatGPT was released and probably didn't involve AI. Anyone can write a wrong customer support script if they try.
- idle_zealot 2y agoThe bad thing is that people still think LLMs can be trusted at all. Companies integrating them into their offerings are not helping the public adopt the correct mental framing of these tools as "plausible text generators".
- deleted 2y ago[deleted]
- dorkwood 2y agoThis can be solved with more data. New tech like Windows Recall should be able to scrape enough of the world's data so that this sort of thing doesn't happen anymore.
- threeseed 2y agoa) There is no evidence that it can be solved with more data. b) Windows Recall data is never going to make its way into public models.
- dorkwood 2y ago> b) Windows Recall data is never going to make its way into public models. It doesn't need to. It just needs to make its way into OpenAI's models, which it will.
- Gigachad 2y agoThe general public is getting lied to constantly. HN users have a bit more context to see through the bullshit but the marketing getting pushed in people is that these AI tools are super genius incredible world changing tools that make everyone 100x more productive.
- dotnet00 2y agoEven many HN users instantly resort to misdirection via comparisons to humans or nebulous upcoming AGI instead of acknowledging that we have to live with these limitations for the forseeable future.
- echoangle 2y agoI mean that’s kind of on meta, as a customer I shouldn’t really have to care about the internals of the company. If a disgruntled employee lies to customers, that shouldn’t be the customers problem either. To me, that’s all just a statement by the company.
- p3rls 2y agoWe're going to see a lot more SEO scams coming from social media platforms now that Google is promoting places like reddit and quora. Even on rSEO you can see moderators there asking themselves questions from alt accounts subtly promoting themselves. It's dog shit scammers all the way down.