6 ms·
Meta's new AI dating coach will kink shame
- Garbleflorp 3y ago[flagged]
- mbb70 3y agoFacebook has over 2,000,000,000 daily active users...
- newleaf 3y ago“Nobody goes there anymore, it’s too crowded.”
- wongarsu 3y ago3 billion by now, and still growing. They may be an "old people platform" in the West, but they have a very solid foothold in emerging markets. Through unfair competition like offering free mobile data for Facebook they have managed to become "the internet" in a couple countries.
- throw_pm23 3y agoThat's good, imagine those people roaming the streets instead..
- achenet 3y agoTFA doesn't exactly strike me as doing a good job of promoting the chatbot... it reminds me more of that Microsoft "Tay" AI.
- COGlory 3y agohttps://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html > Please don't post insinuations about astroturfing, shilling, brigading, foreign agents, and the like. It degrades discussion and is usually mistaken. If you're worried about abuse, email hn@ycombinator.com and we'll look at the data.
- Garbleflorp 3y ago[flagged]
- deleted 3y ago[deleted]
- yieldcrv 3y ago[flagged]
- mensetmanusman 3y agoThe morals and ethics of this are fascinating. Eg. from society’s point of view of supporting young couples for starting families, the ai would recommend one set of obvious recommendations based on sociological data. On the other hand, from a hedonistic point of view of maximizing short term dopamine, it should recommend completely different behavior. It could probably screen the user up front on what the goals of the dating are. Eg. Orgasm versus long term relationship.
- falcolas 3y agoKink and families are hardly exclusive. Most folks I know of are in marriages (or equivalent) and quite a few have kids too. Adding extra dopamine to your reproductive behavior is hardly a bad thing.
- friendzis 3y agoNo, no, no, it should recommend behaviors that create more engagement and ad views
- mtillman 3y agoThis is actually the right answer AND imo the most horrifying aspect of it.
- EGreg 3y agoThis! Why should the corporate shareholders take a hit when there is money to be made? After all these AIs are controlled entirely by the corporation, enough giving away frameworks and weights, gift economies don’t profit the owners The best part is when you have a very “captive audience” in the metaverse. If all your coworkers are using Meta for Work (serious stuff) and for the distributed happy hours, can you afford not to? Say hi to the AI robot bartender, and buy something cool for yourself. Here are some credits Also, when no one is around, why not pop in and talk to your friend’s avatar, who your friend willingly trained on his conversations, shares and likes to become “more efficient”. That surrogate can now respond to tons of queries from other friends’ surrogates as they wish them Happy Birthday in increasingly creative ways. And then you can mix and match your friends to create virtual friends you invite to metaverse parties and video calls — they are trained to gradually maximize revenue and may encourage your group to buy some digital assets or rent a dating venue that you don’t really own :) Or maybe be invited by members of your group and gradually shift the individual members’ thinking to one that is more acceptable to the corporation, never backing down or permanently changing their point of view from any arguments from humans. Simply play some friends against other friends and you can make them all purchase something together, get in line or be ostracized! Imagine how much money can be made by leveraging social capital and hacking people’s relationships. Facebook already cheapened words like “like”, “friend” and birthday wishes. Why not continue to innovate, move fast and break things.
- sdfghswe 3y ago[flagged]
- gtsteve 3y agoThat you can imagine, clearly. There is definitely worse.
- sdfghswe 3y agoI have not just imagination, I also know basically everything that exists in this space. Foot stuff is still the most disgusting.
- achenet 3y agowell actually... https://aella.substack.com/p/fetish-tabooness-vs-popularity https://aella.substack.com/p/fetish-tabooness-vs-popularity
- morkalork 3y agoYou should repost this above its super interesting and a lot of people aren't going to see it because this subthread is dead.
- morkalork 3y agoAs far as kinks go, foot stuff is rather pedestrian
- sdfghswe 3y agoHahaha awesome.
- leosanchez 3y agoThere is poop stuff too ? Isn't it more disgusting?
- sdfghswe 3y ago
- rngname22 3y agoThis is what happens when Product Managers don't understand the technologies they are working with.
- FireBeyond 3y agoTo me, leaving aside whether a dating AI should offer sexual advice (and I think it should) or whether a company should be in a realm it's obviously not entirely comfortable being in... this isn't a Product Manager issue. I see an extremely simple solution to the practical affect of this: delay rendering until it has passed the censorship layer. And provide a simple 'neutral' explanation, "that's not an area I'm able to discuss", versus the very Clippy-like "Woah, it looks like you're trying to learn about red flag things..."
- 23B1 3y agoNobody should trust a FAANG let alone GAI with their most intimate thoughts.
- Maken 3y agoI would trust more a true GAI which runs in my own, controlled devices than any cloud-backed chatbot.
- nerdjon 3y agoI have to wonder, how much of it saying what it is saying is just based on societal views (which leads to most written text that it was likely trained on having a certain opinion) vs supposed "thoughts" on the opinion or pushing certain opinions by the company. Based on the example of it bringing up the ethical slut (fantastic book btw that I highly recommend even for people in monogamous relationships) and then turning around I have to wonder if it is the former. There is still a ton of stigma around non traditional relationships and kink that it makes sense for something like an LLM to lean in that way without additional tuning. Especially when any ethics about releasing untested AI goes completely out the window.
- deleted 3y ago[deleted]
- _yb2s 3y agoI strongly disagree about “The Ethical Slut.” The book endorses abuse and lack of compassion towards partners that are afraid, uninterested, or jealous about the idea of open relationships. It encourages people to basically do what they personally feel like and dismiss pain it causes others as their own problem. There is even a scenario in the book about a woman being bullied into attending a lesbian swinger party, lauding this behavior as helping to expand her horizons (by force). That’s definitely abuse, arguably even a form of rape. No, if people are interested in learning about these topics, get literally any other book. Open relationships require enthusiastic consent from both parties, and emotional sensitivity to your partners needs and feelings.
- nerdjon 3y agoI would be very curious if you could tell me what pages that is on because I do not remember any of this from that book. I remember the book emphasizing communication above all else and did not even shit on Monogamy. What it shit on is society assuming what should be the norm with no discussion. You are right that it requires enthusiastic consent from both parties. But that also doesn't mean that one party has to be unhappy because the other one is not interested in it. At some point you may have to admit that the relationship doesn't have a future if you cannot make this situation work. I feel like too often the focus is on "well I want an open relationship but my partner doesn't so thats the end of that" when in reality its a 2 way street. That doesn't give you a pass to cheat, but it also doesn't mean ignore what may make you happy.
- grotorea 3y agoWhy would the AI answer, then censor itself?
- raincole 3y agoI guess it has multiple models behind the curtain.
- baobabKoodaa 3y agoAnd a PM earned her promotion by prioritizing latency over "safety"
- dontupvoteme 3y agoAlignment tax on the censored version. Why use something that's significantly worse? That's what you release to the public to keep your moat while getting the open source community to build your infrastructure. Very smart of Meta though.
- trey-jones 3y agoOK, I clicked on this for humor but came away with some new ideas about the future of this technology ("AI"), how it will be rolled out, and what I should do about it. Specifically, and as pointed out at the conclusion of this article, corporations deploying "AI" of various shapes are going to do it experimentally like this. They likely don't know the outcomes much better than we do. To me, this presents a risk to early adopters (In this case, people who decide to rely on "AI" to some extent). The effects may ultimately be proven to be positive, but the risk is there, for now. Like the hoverboards that had the potential to spontaneously combust. I will be trying to teach my children that these toys ("AI") are not something to be trusted, for now. And I will take it more seriously than I have been. Use of "AI" in quotes is obviously intentional. Something programmed to avoid certain topics seems to deviate from the definition as I understand it. I don't think we're really see AI yet.
- ProjectArcturis 3y agoThe fact that the bot will answer in a kink-friendly way and then censor itself tells me two things. One, that there are at least two layers -- an answers layer that is probably a typical LLM trained on real-world text, and a censor layer whose job it is to not get Meta in trouble. The censor layer is overzealous because of corporate incentives. Two, Meta has done an awful job architecting this. Like, really, you're going to have the answer bot push its response before the censor bot even looks at it? And if something needs to change, you delete the original answer and push the censored one? I can only imagine this was done to reduce answer latency, but God what awful UX that creates.
- dado3212 3y agoBing does the same thing, I think just optimizing for latency. Admittedly it probably shaves off 10-15s in the usual response, I’d probably make the same decision.
- baobabKoodaa 3y agoWhen Bing AI first launched there were some really shenanigans where the AI would threaten to blackmail or murder the user and half a second later delete the message and replace it with a censored one.
- O_nlogn 3y agochat GPT has the same behaviour, no? I've had it send most or all of a response before the censor system triggers it to be redacted.
- itishappy 3y agoAnyone know how the API deals with this? Does it send a response, then a follow-up payload with an "ohshit plz delete that" message?
- xg15 3y agoThe funny thing is that the "plz delete" messages have to be executed by the browser javascript. So in theory, you should be able to capture the "deleted" messages by keeping the network tab open or recording the traffic, right? Edit: Last time I checked, ChatGPTs web interface was using server-sent events to stream the response words. The events were clearly visible in the network tab if you opened it early enough. So if it sends "delete" messages, they should show up in there.
- ProllyInfamous 3y agookay, Daddy...
- xeckr 3y ago>In the sexual landscape of 2023, swinging feels quaint What universe does the author live in? ...oh, the same one who brings the founder of Kinkster into the discussion to tell the audience that the AI censoring such topics is Actually Bad For The Children.
- deleted 3y ago[deleted]
- jstarfish 3y agoSwinging is quaint. Who has sex with other people anymore? We're all technosexual these days. If it doesn't involve a scalpel or a bank of GPUs, you're just vanilla.
- danShumway 3y agoSeparate from any conversations about censorship, ethics, priority, etc... this is really representative about how utterly clueless and thoughtless companies are being about AI right now. Because multiple people on Facebook signed off on the idea of a chat bot that gives dating advice and somehow they didn't see this coming? Yeah, no duh the people you gave the dating robot too asked it questions about sex. That's not surprising. How out of touch with reality does a company have to be to think it's even physically possible to have an LLM chatbot in that category that stays family friendly? Nobody who is actually familiar with LLMs would think that's a good idea. And I think this fits right into what a lot of companies are doing with AI right now, which is to completely ignore any questions about what the scope of what they're trying to do is, whether LLMs are a good fit for what they're trying to do, whether what they're trying to do is even appropriate for their business in the first place, what the failure modes are -- there's no caution around security or ethics, but there's also not even any thought into whether what they're building is useful or fits any product need. I'm not saying that AI doesn't have uses, it clearly does, but there is a level of hype currently that seems be causing executives to turn into hyperactive toddlers. So a bunch of products get launched where AI isn't really a good fit, where it has clear failure modes, and where it's not clear what the companies even want the product's behavior to be or why any of their users would want the thing they're offering. Seriously, who wants a dating advice robot made by Facebook? But it just gets launched anyway because "it's an LLM and we do those, we're hip. We have that. We have all of it." It's just so silly. Nobody put a gun to Facebook's head and forced them to put out a dating advice chatbot, and the results of a dating advice chatbot are completely predictable. Did they run out of ideas for other chatbots they could do instead? The knitting advice chatbot wasn't working well enough, so they needed this one? And it's not just Facebook. ChatGPT as far as I know is still vulnerable to several cross-site user data exfiltration attacks purely because... they don't want to restrict 3rd-party URLs in markdown images. Why? What's wrong with you? Just because a thing exists you don't have to throw the entire kitchen sink at it, you're allowed to think about your products for more than 3 minutes and ask questions like "why would it be essential that our AI chatbot be able to inline-display arbitrary 3rd-party images?" Most email clients don't even do that by default. So Facebook's response is: "we’re training our models on safety and responsibility guidelines. Teaching the models guidelines means they are less likely to share responses that are potentially harmful or inappropriate for all ages on our apps." But my siblings in Christ, you launched a chatbot that encourages users to ask it for romantic relationship tips. Like, come on. That's on you, that was a mistake you could have avoided by having anyone in the product team be thinking anything deeper at all other than "we have the AIs now, everybody look at us!" It's not even people abusing the product, y'all launched a product that encourages people to ask questions that you don't want to answer.
- FireBeyond 3y ago> For example, Instagram was once so nipple-allergic that it prohibited pictures of women in many non-sexual contexts such as breastfeeding, even in cases where the nipples themselves weren’t actually visible. The problem sparked an international “Free the Nipple” campaign. After years of corporate resistance, the protest ultimately forced the company to relax its rules about bare-chested women and transgender people. More like "Free the Breast". You still can't show a nipple that's not blurred or pixelated on Instagram (many photographers use pixelation, because on the thumbnail, it will look uncensored).