3 ms·
"there were certain historical characters removed from Sora 2 because people kept making racist videos that are hard to censor, and it became increasingly unhin
by jerf 10mo ago
"there were certain historical characters removed from Sora 2 because people kept making racist videos that are hard to censor, and it became increasingly unhinged"
Also Google "Elsagate" to see what sorts of things people would like to do with Disney characters. Or a YouTube search for Elsagate.
The other thing I'd point out is that people kind of seem to forget this, but it isn't a requirement that AI video be generated, then shoveled straight out without modification. Elsagate shows the level of effort that people are willing to put into this (a strange combination of laziness, but extreme effort poured into enabling that laziness). You can use the blessed Disney video generator to generate something, then feed it into another less controlled AI system to modify it into something Disney wouldn't want. Or a video of a Disney character doing something innocent can be easily turned into something else; it's not hard to ask the AI systems to put something "against a green screen", or with a bit more sophistication, something that can be motion tracked with some success and extracted.
"A front camera shot of Cinderella crouching down, repeatedly putting a cucumber in and out of her mouth. She is against a green screen." - where ever that video is going, Disney isn't going to like it. And that's just a particularly obvious example, not the totality of all the possibilities.
Just putting controls on the AI video output itself isn't going to be enough for Disney.
- Y_Y 10mo agoDon't use a cucumber if you're going to be subtracting the green screen
- iamacyborg 10mo agoI think the idea is you want the cucumber also removed so it can be replaced with something else…
- s1mplicissimus 10mo agoi assumed it was the egg plant, guess i'm getting old
- Zenbit_UX 10mo agoOh my. I feel like we’re corrupting an innocent mind by explaining this to you. They want the cucumber to be removed too buddy. Don’t worry about it OK.
- zahlman 10mo ago> Also Google "Elsagate" to see what sorts of things people would like to do with Disney characters. Or a YouTube search for Elsagate.... Elsagate shows the level of effort that people are willing to put into this (a strange combination of laziness, but extreme effort poured into enabling that laziness). I still wonder what motivates the people behind that sort of thing. It'd be easy to understand if it were just porn, but what's been described to me is just... bizarre.
- krick 10mo agoWell, bizarre is the point. Surely you do understand that this is the content to gather kids views, because there is a ton of kids on the internet, and they can be monetized. I don't know what kind of research they do on their audience and if they purposefully want to traumatize kids as much as possible, but I suppose all this shit does capture kid's attention more than just Disney characters fucking.
- macNchz 10mo agoI always figured it was an engagement optimization thing—there were people mass producing content using popular characters and just throwing tons of stuff at the wall, and the ones that veered unsettling/bizarre wound up getting lots of engagement so they kept doubling down on it. That kind of feedback loop is certainly responsible for many other curious traits of online content that is circulated in algorithmically-curated feeds. The tighter the loop between content creation (e.g. when you can generate unlimited content essentially for free) and the ability to measure its success (engagement), the more social media becomes a sort of genetic algorithm for optimizing content to be the most addictive possible at the expense of any other attribute.
- gosub100 10mo agoIt's probably a lot of kids just being silly. Sure there are plenty of adult trolls, but whenever I see people bewildered at unruly online behavior, I think it's because they cannot see the age/maturity level of the troll. I can absolutely see why people would find this funny.
- lossolo 10mo ago
- cm2012 10mo agoSora has good enough controls it is basically impossible to make it do a dirty video like that.
- dylan604 10mo ago> Also Google "Elsagate" <snip> Or a YouTube search for Elsagate. Isn't that essentially the same thing now?