5 ms·

nsfw.rest – Keep your platform safe of NSFW content, all for free

13 points by lngzl 5y ago

RicoElectrico 5y ago
Can you consider giving a score instead of a binary decision? Or differentiate between, say, beach pics and true 18+ content. Edit: The accuracy leaves a lot to be desired - you can paste any images from clothing stores of models in dresses or tank tops and it will flag it as NSFW. The "AI" seems to replicate an Islamic fundamentalist - a woman in a burqa did pass as SFW ;) Google offers a hosted SafeSearch version [1] which has a lot more nuance: https://cloud.google.com/vision/docs/reference/rpc/google.cloud.vision.v1#google.cloud.vision.v1.SafeSearchAnnotation https://cloud.google.com/vision/docs/reference/rpc/google.cl...
- swiley 5y ago
  The whole thing is built to export moderation to an external service. It's a bit creepy IMO.
  - lngzl 5y ago
    I totally get that. That's why I'm planning on making the service (or at least parts of the service) open source. You can already get insights in the storage usage of the server through status.lngzl.nl (click scan.nsfw.rest). If you upload files, the storage size does not increase. Also, one of the things I should make a little bit more clear is that it's best paired with data that will be made public anyways (for example, a social media platform) and shouldn't be run on private images (even though it's not storing anything it's probably not needed for those use cases).
- lngzl 5y ago
  It gives a score as well, in the API, I can for sure add that to what you see on the "Try out" page. I was planning on adding a button where you could see the raw data.
- soared 5y ago
  Corporate uses of nsfw filters typically want to filter out clothing store models and similar content. “Brand safe”
tentacleuno 5y ago
It's a good idea in theory, but what if it shuts down? And what about the privacy implications of sending all images to some server across the world?
- lngzl 5y ago
  That's a really good question! I'm planning on making parts of it open source and for mission critical applications (for example, companies like Discord) that they have the option to host it on their own hardware. If the project fails, I'll make it completely open source so that people can continue to use it.
  - tentacleuno 5y ago
    Oh brilliant! All power to you, then man :-)
nextaccountic 5y ago
What are the API limits? That is, how many images scanned is too many?
- lngzl 5y ago
  Currently, no limits. As long as it doesn't look like a DDoS attack nothing will be blocked.
peanut_worm 5y ago
It marked 3/4 SFW images as NSFW and then marked the only NSFW image I uploaded as being OK. I am not sure this thing is very accurate at all.
- Elidrake24 5y ago
  You’ve got me curious; would you mind sharing the images used? The SFW images that were mislabeled, rather.
  - lngzl 5y ago
    I added a number from 0-100 how confident it is
  - peanut_worm 5y ago
    I used a picture of myself, a picture of a tan colored bird and a Mortal Kombat character and it marked them all as NSFW
cucumb3rrelish 5y ago
Amazing accuracy, I tried to trick it but it got everything right
- lngzl 5y ago
  Awesome! It's based on an open source model :)

13 points by lngzl 5y ago

Can you consider giving a score instead of a binary decision? Or differentiate between, say, beach pics and true 18+ content. Edit: The accuracy leaves a lot to be desired - you can paste any images from clothing stores of models in dresses or tank tops and it will flag it as NSFW. The "AI" seems to replicate an Islamic fundamentalist - a woman in a burqa did pass as SFW ;) Google offers a hosted SafeSearch version [1] which has a lot more nuance: https://cloud.google.com/vision/docs/reference/rpc/google.cloud.vision.v1#google.cloud.vision.v1.SafeSearchAnnotation https://cloud.google.com/vision/docs/reference/rpc/google.cl...

swiley 5y ago
The whole thing is built to export moderation to an external service. It's a bit creepy IMO.
- lngzl 5y ago
  I totally get that. That's why I'm planning on making the service (or at least parts of the service) open source. You can already get insights in the storage usage of the server through status.lngzl.nl (click scan.nsfw.rest). If you upload files, the storage size does not increase. Also, one of the things I should make a little bit more clear is that it's best paired with data that will be made public anyways (for example, a social media platform) and shouldn't be run on private images (even though it's not storing anything it's probably not needed for those use cases).
lngzl 5y ago
It gives a score as well, in the API, I can for sure add that to what you see on the "Try out" page. I was planning on adding a button where you could see the raw data.
soared 5y ago
Corporate uses of nsfw filters typically want to filter out clothing store models and similar content. “Brand safe”

tentacleuno 5y ago

It's a good idea in theory, but what if it shuts down? And what about the privacy implications of sending all images to some server across the world?

lngzl 5y ago
That's a really good question! I'm planning on making parts of it open source and for mission critical applications (for example, companies like Discord) that they have the option to host it on their own hardware. If the project fails, I'll make it completely open source so that people can continue to use it.
- tentacleuno 5y ago
  Oh brilliant! All power to you, then man :-)

nextaccountic 5y ago

What are the API limits? That is, how many images scanned is too many?

lngzl 5y ago
Currently, no limits. As long as it doesn't look like a DDoS attack nothing will be blocked.

peanut_worm 5y ago

It marked 3/4 SFW images as NSFW and then marked the only NSFW image I uploaded as being OK. I am not sure this thing is very accurate at all.

Elidrake24 5y ago
You’ve got me curious; would you mind sharing the images used? The SFW images that were mislabeled, rather.
- lngzl 5y ago
  I added a number from 0-100 how confident it is
- peanut_worm 5y ago
  I used a picture of myself, a picture of a tan colored bird and a Mortal Kombat character and it marked them all as NSFW

cucumb3rrelish 5y ago

Amazing accuracy, I tried to trick it but it got everything right

lngzl 5y ago
Awesome! It's based on an open source model :)