2 ms·
I run an online community, with my own developed software. We use lots of different tools to prevent spam, harassment, etc. We use different APIS to check IP, A
by freitasm 4y ago
I run an online community, with my own developed software. We use lots of different tools to prevent spam, harassment, etc. We use different APIS to check IP, ASN, email for previous spam behaviour, use of disposable email domains, etc.
We have a team of moderators and as mentioned before you can "smell" something brewing. The words, to whom they are directed, etc.
A couple of years ago we started using Perspective API [0], a Google service
"Using machine learning to reduce toxicity online". We use the toxicity model, trained by Google and The NY Times. Basically we submit the text of posts and replies and receive a score. We do some account history calculations and if it's past a certain threshold then moderators receive a notification - we can't read all posts in our platform all the time but this helps a lot.
The community itself helps too, and the reporting tool is used when things happen that we aren't aware.
[0] https://www.perspectiveapi.com/#/home https://www.perspectiveapi.com/#/home