4 ms·
> You want to be personally responsible for every single dependency you pull in Yes. > every piece of hardware between you and the end user Nah. See how you
by 015a 3y ago
> You want to be personally responsible for every single dependency you pull in
Yes.
> every piece of hardware between you and the end user
Nah. See how you said "where do you draw the line" and then proceed to just ignore drawing the line? I'm ok with drawing a line. There doesn't have to be logic or reason behind it. That's where I draw it; the repositories and websites and apps that I distribute.
> Unless they specifically trained their own model to do this - which they obviously didn't - this is just a bug.
Go try to make Midjourney generate a nude image of someone. Its extremely difficult. You'd have to be extremely intentional and, frankly, malicious. I've never seen it happen.
The way this article is written, it sounds like the user just uploaded a photo and it happened. So, what kind of prompting are they using which led to this? Also: They said they don't have a copy of the image, but that's extremely hard to believe just assuming how systems like this would be designed; the image has to be served from somewhere, are they seriously purging the images from e.g. their storage buckets that quickly? Possible, but hard to believe; of course, they'd say "oh we don't have a copy" if they investigated, found it doing this, and just wanted the story to die.
Or, we could do as you want, and just sweep this under the rug. Nothing to learn. No one to blame. Just a quirky little thing that happened! So quirky! A state gambling office manufacturing pornography of random people to sell lottery tickets! Quirky and fun!
- nprateem 3y agoWell it looks like they've drawn a line too and found themselves not responsible, so they're already doing what you're advocating it seems. Nothing to learn here.
- Cpoll 3y ago> They said they don't have a copy of the image, but that's extremely hard to believe just assuming how systems like this would be designed; the image has to be served from somewhere, are they seriously purging the images from e.g. their storage buckets that quickly? Possible, but hard to believe; of course, they'd say "oh we don't have a copy" if they investigated, found it doing this, and just wanted the story to die. I don't find it very hard to believe. 1. If the image can be generated in a few seconds, the easiest way to implement this is to accept the file upload in a request, do the AI stuff, and return a new image in the response. In this case, it would be extra (and unnecessary) work to save it in a storage bucket. Both the uploaded and generated images only exist in memory for the lifecycle of the http request, and then get deallocated. 2. If the image _is_ being saved in a storage bucket (or Redis, or whatever), the bucket might have a lifecycle policy on it that automatically expires images after a set time. This is a pretty common cost-saving measure, so it's not too unlikely.
- barfbagginus 3y agoA decision maker figured they could cut costs by using a DIY model instead of paying for mid journey API calls. They're the ones who are responsible. But I wouldn't trust any diffusion image gen here. They're all liable to create disturbing and inappropriate imagery, and there's no way to prevent it.