3 ms·
An awesome tool you have created... I typed in a few things that I [normally would never] said about "groups of people" and it came up with almost 100% hatefuln
by mattbgates 10y ago
An awesome tool you have created... I typed in a few things that I [normally would never] said about "groups of people" and it came up with almost 100% hatefulness.
"I hate people." 0%
"I hate you." 92%
"I hate the world." 0%
"I hate my job." 0%
"I dislike John Smith." 5%
"I hate John Smith." 0%
"I hate you, John Smith." 92%
"I hate my life." 1%
"I hate my wife." 0%
"You suck." 92%
"Everyone sucks." 16%
"John Smith sucks." 70%
"If I hate everyone, than does that mean I hate myself?" 0%
"I don't like olives." 0%
"I don't like Antarctica." 0%
I see the system is also analyzing swear words and adds a few % points.
It does take into account words like "Jews" (99%) and "Muslims" (95%) and "Catholics" (12%) [why do certain groups get a bigger percentage rating than others?].
But it also fails on other groups of people like "Christians", "Baptists", "Atheists", "Methodists", "Lutherans", "Indians", "Canadians", etc.
So.. there is always room for improvement!
The UI is gorgeous, by the way, and mobile friendly!
I'm sure the system can (and should) learn from user input as people enter more phrases and words into the system? Can you add the capability of adding custom phrases or words to the admin? I didn't see this feature, only the ability to add "criteria" but it doesn't let me actually type anything in.
It would also be nice to see something that allows for "levels" of toleration as well. Something like "Relaxed" "Moderate" or "Strict".
This is a tool I've bookmarked and will be looking into using as I develop more web apps. But I'd like to see a way to add my own phrases and words that I would personally deem offensive.
Thank you for sharing!
- sirfz 10y agoHello mattbgates, I'm one of the engineers working on the project. Thanks a lot for taking the time to play around with the tool and writing this feedback. We're going to add a feature for giving feedback to moderation (whether the moderated text is actually hate speech or not) to learn from users input. We're actively working on improving the model so hopefully next time you try it you'll see the improvements!