3 ms·
This is the big challenge of any platform for user-generated content and it's incredibly difficult to scale, do well and be economical. A bit like CAP, it's alm
by jmyeet 2y ago
This is the big challenge of any platform for user-generated content and it's incredibly difficult to scale, do well and be economical. A bit like CAP, it's almost like "pick 2". You will have to deal with:
- CSAM
- Lower-degree offensive material eg Youtube had an issue a few years ago where (likely) predators were commenting timestamps on inocuous videos featuring children or on Tiktok videos with children get saved way more often. I would honestly advise any parent to never publicly post videos or photos of your children to any platform, ever.
- Compliance with regulation in different countries (eg NetzDG in Germany);
- Compliance with legal orders to take down content
- Compliance with legal orders to preserve content
- Porn, real or AI
- Weaponization of reporting systems to silence opinions. Anyone who uses Tiktok is familiar with this. Tiktok clearly will simply take down comments and videos when they receive a certain number of reports without it ever being reviewed by a human, giving you the option to appeal
- Brigading
- Cyberbullying and harassment
This is one reason why "true" federation doesn't really work. Either the content on Bluesky (or any other platform) has to go through a central review process, in which case it's not really federated, or these systems need to be duplicated across more than one node.
- sailfast 2y agoAgreed - moderation at scale is a tough and expensive problem to get right. That said, I wonder how much these days it would take to get it working well enough using existing LLMs. I'm not sure how much you would need to do that wasn't a bit off the shelf if you were mostly trying to keep your safe harbor protections / avoid regulator scorn.