5 ms·
I strongly dislike the current black/white stance around it being either censored or not. If someone wants to build a sexting bot...go for it & have fun. But s
by Havoc 3y ago
I strongly dislike the current black/white stance around it being either censored or not.
If someone wants to build a sexting bot...go for it & have fun. But stuff like engineering humanity ended viruses...yeah maybe suppressing that isn't the worst of ideas.
Which puts us on a slippery slope of where to draw the line yes, but such is reality - a murky grey scale.
- boneitis 3y agoNot even a week ago, I tried _actually_ using ChatGPT for the first time beyond silly novelty prompts, saw the value immediately, and subscribed to GPT4 like the Fry meme. Looking at the pretty extensive list of what you're outright not allowed to query on their TOSes and the amount of times I hit the stonewalls, I'll readily point the finger at them. (Yes, invested board members, laws, regulations, snooping state actors, nat'l security, etc., I get it.) I've been bitten by the bug and am already looking to see what people can really do with these less-encumbered, self-hosted options. I'll be happy to see the day where the climate looks more like a spectrum than black/white.
- boneitis 3y agoSelf-reply; response was a bit kneejerk. I think the rhetoric in my last statement needn't be as cynical. After all, I've only just started looking at all at these AI chat developments and still have loads to explore.
- cypress66 3y agoCurrent LLMs are incabale of something like that so it doesn't matter.
- kromem 3y agoIt's also a false sense of security. A bad actor can sidestep alignment safety measures fairly successfully for the foreseeable future using dynamic jailbreaking efforts. Good actors get penalized by the product being made notably worse to prevent that. Perhaps a better approach would be having an uncensored model behind a discriminator trained to detect 'unsafe' responses and return an error if detected. This would both catch jailbreaking by bad actors which successfully returned dangerous responses and accidentally dangerous responses. But it would be far less likely to prevent a user asking for a dangerously spicy recipe from getting it. There's an increased API cost because you are paying for two passes instead of one, but personally I'd rather pay 2x the cost for an excellent AI than half cost for a mediocre one.