4 ms·
> We are forming an open source committee to decide on major issues like cleaning data, NSFW policies and formal guidelines for model release. I don't see how
by yellow_lead 4y ago
> We are forming an open source committee to decide on major issues like cleaning data, NSFW policies and formal guidelines for model release.
I don't see how NSFW photos can easily be stopped from being generated, with the model being open source. Maybe the model could be heavily pre-filtered to remove any photos that could possibly be used for NSFW images.
- lbotos 4y agoMy understanding is it was trained on this dataset: https://rom1504.github.io/clip-retrieval/?back=https%3A%2F%2Fknn5.laion.ai&index=laion5B&useMclip=false https://rom1504.github.io/clip-retrieval/?back=https%3A%2F%2... Which has a LOT of NSFW images in it. I suspect if you removed them from the training set it would go a long way to curb NSFW output but as you say people could easily train their own NSFW latent diffusion model.
- kmeisthax 4y agoMy experience with Stable Diffusion is that it has a habit of tripping the NSFW filter - as in, it actually generated NSFW images - on prompts that were entirely innocuous. Would not be surprised if Stability has a huge "how do we get it to stop spitting out porn so easily" problem.