5 ms·
> And there's a whole set of ethically-justifiable but rule-flagging conversations (loosely categorizable as things like "sensitive", "ethically-borderline-but-
by barbazoo 6mo ago
> And there's a whole set of ethically-justifiable but rule-flagging conversations (loosely categorizable as things like "sensitive", "ethically-borderline-but-productive" or "violating sacred cows") that are now possible with this, and at a level never before possible until now.
I checked the abliterate script and I don't yet understand what it does or what the result is. What are the conversations this enables?
- throwuxiytayq 6mo agoThe in-ter-net is for porn
- spijdar 6mo agoRealistically, a lot of people do this for porn. In my experience, though, it's necessary to do anything security related. Interestingly, the big models have fewer refusals for me when I ask e.g. "in <X> situation, how do you exploit <Y>?", but local models will frequently flat out refuse, unless the model has been abliterated.
- tredre3 6mo agoFrom what I've seen gemma 4 doesn't refuse a lot regarding sex, it only needs little nudging in the right direction sometimes. But it does refuse being critical of the usual topics: israel, islam, trans, or race. So wanting to discuss one of those is the real reason people would use an uncensored model.
- Auracle 6mo agoIt’s so dispiriting to me that we’ve achieved those closest thing yet to an “objective truth” machine (with the caveat of garbage in, garbage out, etc.) and these big companies are either afraid to actually let it exist, want to push their own politics, or a combination of the two.
- ben_w 6mo ago"closest thing yet" is still a long way from close; as you say, gin=gout, and the internet without an attempt to be our best selves is instead our loudest propagandists and all our cultural stereotypes. Of course, humans are also impacted by these things, at best we can be a little deliberate about rejecting a few of the more on-the-nose examples.
- raddan 6mo agoA collection of statistical patterns is hardly objective truth. If that’s what you think an LLM is, you’re mistaken.
- spwa4 6mo agoSure, but in case you've been living under a rock for the past year, that's exactly what people have been using it for for 2 years now. Of course, it's actually an improvement over a Google search. And, yeah, a bit of finetuning will change the LLMs opinion on any subject. Which the big companies probably see as an advantage.
- avadodin 6mo agoSo–called uncensored versions simply do not refuse addressing a topic. They do not guarantee an alignment with reality. A truly uncensored model is impossible as human societies exist under various censorship regimes, anyways.
- int_19h 6mo agoWith local models there's usually a trivial workaround of prefilling their response so that they have already agreed to do what you ask.
- pmarreck 6mo ago1) Coming up with any valid criticism of Islam at all (for some reason, criticisms of Christianity or Judaism are perfectly allowed even with public models!). 2) Asking questions about sketchy things. Simply asking should not be censored. 3) I don't use it for this, but porn or foul language. 4) Imitating or representing a public figure is often blocked. 5) Asking security-related questions when you are trying to do security. 6) For those who have had it, people who are trying to use AI to deal with traumatic experiences that are illegal to even describe. Many other instances.
- junofan 6mo agoThe manufacturing of biologics can be heavily censored to an absurd degree. I don’t know about Gemma 4 in particular.
- pmarreck 6mo agoReally? That's fascinating. Why is that?
- ben_w 6mo agoDo you want every malicious idiot in the world to have a competent helper for bioweapons? Or indeed an incompetent but enthusiastic helper accidentally getting them to posion themselves and friends with botox:? https://news.ycombinator.com/item?id=40724283 https://news.ycombinator.com/item?id=40724283 That is why they were pushed away from this. At least with vibe coded software, errors may prevent compilation, then when we're past that simply bad experiences, before they become human catastrophes.
- avadodin 6mo agoAny competent high schooler knows about water activity and sterilization. At least at the fundamental level. I doubt most models refuse providing recipes without 0 risk of death. LLMs are —if anything— ridiculously proficient at making random code compile. What was your point again?
- SL61 6mo agoLLMs are very helpful for transcribing handwritten historical documents, but sometimes those documents contain language/ideas that a perfectly aligned LLM will refuse to output. Sometimes as a hard refusal, sometimes (even worse) by subtly cleaning up the language. In my experience the latest batch of models are a lot better at transcribing the text verbatim without moralizing about it (i.e. at "understanding" that they're fulfilling a neutral role as a transcriber), but it was a really big issue in the GPT-3/4 era.
- dolebirchwood 6mo agoI have a project where I'm using LLMs to parse data from PDFs with a very complicated tabular layout. I've been using the latest Gemini models (flash and pro) for their strong visual reasoning, and they've generally been doing a really good job at it. My prompt states that their job is to extract the text exactly as it appears in the PDF. One data point to be extracted is the race of each person listed. In one case, someone's race was "Indian". Gemini decided to extract it as "Native American". So ridiculous.
- janalsncm 6mo agoAccording to Gemini, Native America is the most populous country.
- devmor 6mo agoI was attempting to help someone who runs a small shop selling restored clothing set up a gemini pipeline that would restage images she took of clothing items with bad lighting, backgrounds, etc. Basically anything that showed any “skin” on a mannequin it would refuse to interact with. Even just a top, unless she put pants on the mannequin. It was infuriating.
- qingcharles 6mo agoPhotoshop's AI tools will fail constantly if you try to say, remove an extraneous wire or a tree branch etc in a photo that has women showing any bare arms or legs etc. Works fine with men with no shirts on. It pops up some moralizing text and refuses to continue.