3 ms·
As someone building products with AI models, the safety guardrails are very helpful and save me a ton of work. Like to the point that it would be a very tough s
by rgbrgb 3y ago
As someone building products with AI models, the safety guardrails are very helpful and save me a ton of work. Like to the point that it would be a very tough sell for me to integrate a model without those features even if it were much better in other ways.
Are there more of me or you?
My specific example is that most image generators have a default setting to reject queries for porn and some do processing after generation to detect generated porn. Does it do nipple detection? I haven't thought much about it and that's kind of the point. The result is that it's hard to generate porn with my tool and that saves me a ton of time moderating or building complex filters myself.
- cypress66 3y agoWhat's the problem with generating porn, assuming that's what the user asked for?
- rgbrgb 3y agoIn our context, images are viewable by others on the site so to support porn we'd want some part of the site that was walled off from kids / had an NSFW warning. That's a lot of extra work to add to our mvp. edit: Morally I def have no problem with it and I do wish they all had a toggle on/off (defaulted to on for sanity).