5 ms·
> Conversations with the characters quickly went sideways when some users peppered them with questions including who created and developed the AI. Liv, for inst
by Trasmatta 2y ago
> Conversations with the characters quickly went sideways when some users peppered them with questions including who created and developed the AI. Liv, for instance, said that her creator team included zero Black people and was predominantly white and male. It was a “pretty glaring omission given my identity”, the bot wrote in response to a question from the Washington Post columnist Karen Attiah.
This is probably true, but the AI almost certainly hallucinated these facts.
- az226 2y agoFor sure.
- AIFounder 2y ago[dead]
- elphinstone 2y agoA woke bot from a woke workforce unintentionally created a parody of wokeness. Keep 'em coming.
- hopfenspergerj 2y agoIf you’re meta and you have to defend the AI by admitting “it’s not really intelligent and everything it says is bullshit”, that’s not a position of strength.
- notahacker 2y agoParticularly when it's likely that despite the AI bullshitting in the absence of data on its creators, it's also incidentally true that the "black queer momma" persona is a few lines of behavioural stereotypes composed by white male programmers without any particular experience of black queer mommas.
- thwarted 2y agoIf the intent is to make a recognizable caricature and apply labels to it (cough stereotype), you don't have someone draw themselves. And it's really looking like stereotyping is their intent.
- yieldcrv 2y agoI dont think that necessarily applies when you could easily make a training set from some actual black American people’s writings on the internet or book, or even an individual that self identified that way and train on all their writings around the internet, and result in those same stereotypes when you ask an AI to create such a profile You dont need a black American engineer or product manager to say “I approve this message” or “halt! my representation is more important here and this product would never fly” as they are just not person the data set was trained on, even if you asked an AI to just create the byline on the profile for such a character its weirder, and more racially insensitive, for people to be vicariously offended on behalf of the group and still not understand the group. In this case, the engineer or product manager or other decision maker wouldnt have the same background as the person that would call themselves “momma”, let alone it not mattering at all, if you can regurgitate that from a training set
- notahacker 2y agoI mean, sure, some programmers with very little experience of queer black mommas could, hypothetically, be so good at curating information from the internet and carrying out training exercises that they created a persona that convincingly represents a queer black momma. Do we think this is what happened in this instance? In which, ironically, the bot called it a "glaring omission"
- yieldcrv 2y agothe bot is echoing sentiments of comment sections it was trained on and had no idea of its origins its acting aware and sensitive but only has information about the tech sector as a whole my critique is about how the standards being applied are dumb all the way down. the standards are not actually that enlightened even if there was more representation congruent with the race/identity being caricatured as representation. nullifying the whole criticism. the training set is the only thing thats important with a language model. and its just a symptom of dead internet theory, as even the persona’s byline was probably generated by a different language model.
- 2y ago
- dawnerd 2y agoMicrosoft tried this ages ago with their Tay chatbot and found how quickly it went bad.
- devjab 2y agoI'm Scandinavian and not invested in the American culture wars and I still got a good chuckle out of how bad an idea this was. Who on earth could've thought it was a good idea to get an AI to pretend to be a black queer mother of two? I'm sure it'll piss off a lot of anti-woke people, but really, how on earth did the issues with this not become obvious for the team? I'm not sure if the AI knows who trained it (and I wonder how they did it) but the team can't have included a lot of common sense or real world experience for them to do something so fundementally stupid.
- karel-3d 2y agoI think it will piss off woke people, too. It seems designed to piss off everyone.
- notavalleyman 2y agoThe article indicates that it was one of 28 personas created by meta. However, the reporters in between the story and you, thought that one would be interesting to you and so promoted it's relevance. In actuality, if you rolled a dice of potential human traits 28 times, this could be a statistically normal combination
- Jerrrry 2y agoLol 1 outta 28 isn't a black queer mom of two. The clash of these characteristics is what defy and define these unlikely odds. This is trolling rage bait. Like most big corp content.
- notavalleyman 2y agoI'm not sure if you're joking but your comment expresses it backwards - according to the op article, meta made 28 such bots. One of those bots had the insta profile tagline "queer black mom". In between meta's creation of the 28 and the story arriving on your dinner plate, someone decided to focus the coverage on that one of 28. They thought it would be interesting to people and clearly were right
- throwaway48476 2y agoI hate the journalists pretending that ML is regurgitating facts instead of just random tokens. The ML model doesn't know who programmed it and can't know because that wasn't in the training data.
- Kbelicius 2y ago> I hate the journalists pretending that ML is regurgitating facts instead of just random tokens. They aren't claiming that what the AI said was fact. It seems your hate comes from lack of understanding.
- probably_wrong 2y agoI don't think companies should be allowed to double dip. If they want to put AI EVERYWHERE then they don't get to hide behind "their output is not to be taken seriously" afterwards.
- nitwit005 2y agoThey don't appear to have done so. They just shared what they asked it, and screenshots of the conversation: https://bsky.app/profile/karenattiah.bsky.social/post/3letty2t4ik2c https://bsky.app/profile/karenattiah.bsky.social/post/3letty...
- warkdarrior 2y agoI hate the game reviewers pretending that games are providing entertainment instead of just random numbers in RAM and random pixels on the screen. The game doesn't know who programmed it and can't know because that wasn't in its source code.
- stefan_ 2y agoHuh? On the balance of probabilities, why would this be the "most certain" option? I think that logic only works on the HN scale of "works in my ChatGPT window" or "bad outcome, so hallucinated".
- redleader55 2y ago> This is probably true, I'm not sure we get to both complain that bots are trained by "white males" and at the same time complain that big tech abuse H1B visas for cheap compliant labourers.