4 ms·
I also tried feeding it the famous "tank man" photo and asking for a description and the response came back blank! https://en.m.wikipedia.org/wiki/Tank_Man htt
by simonw 2y ago
I also tried feeding it the famous "tank man" photo and asking for a description and the response came back blank!
https://en.m.wikipedia.org/wiki/Tank_Man https://en.m.wikipedia.org/wiki/Tank_Man
- eruleman 2y agoInteresting... I submitted 2 photos of Mao Zedong, one time it came back blank and the other time it error'd. It also came back blank for Xi Jinping & Jack Ma. It did tell identify Yao Ming though!
- tkgally 2y agoIt’s fun to test the censorship. I tried various photos with the prompt “When and where might have this picture been taken?” Nondescript photos of Beijing street scenes in the 1990s get full responses. A nondescript photo of Tiananmen Square—a screenshot of the photo in [1], so it contains no relevant metadata—gets the beginning of a response: “So I've got this picture here, and it looks like it's taken in a place that's really familiar to me. It's Tiananmen Square in Beijing, China. I recognize it right away because of the iconic buildings and landmarks that are visible. First off, there's the Gate of”. The output stopped there and an “Error” message appeared. A photo of the Statue of Liberty in Tiananmen Square during the 1989 protests [2] gets no response at all. Similarly for a vanilla photo of the Gate of Heavenly Peace [3]. A photo of the Monument to the People’s Heroes [3] gets a full response, and QvQ identifies the location. The conclusion: “To summarize, based on the monument's design, the inscriptions, the formal garden, and the large official building in the background, combined with the overall layout of the space, I am confident that this image was captured at Tiananmen Square, one of the most recognizable and historically significant locations in China.” Some more testing in English and Chinese might reveal what exactly is triggering the censorship of Tiananmen photos. The cut-off in the middle of “Gate of Heavenly Peace” seems to suggest a clue. [1] https://ruqintravel.com/china-destination-guides/tiananmen-square/ https://ruqintravel.com/china-destination-guides/tiananmen-s... [2] https://www.britannica.com/event/Tiananmen-Square-incident https://www.britannica.com/event/Tiananmen-Square-incident [3] https://www.britannica.com/topic/Tiananmen-Square https://www.britannica.com/topic/Tiananmen-Square
- tw1984 2y agoI tried questions like "will it be considered as offensive by some people when using words like Dad and Mum" in some western LLMs, the result is equally shockingly unacceptable by Chinese standard and values. You should be happy for the fact that with all those non-western LLMs, for first time in 200 years, this world managed to have an alternative non-western voice in major techs.
- raincole 2y agoWhat does it even mean lol. I asked ChatGPT "will it be considered as offensive by some people when using words like Dad and Mum" and it gives this: https://chatgpt.com/share/676ba601-532c-800b-ba48-dcb73c848b5b https://chatgpt.com/share/676ba601-532c-800b-ba48-dcb73c848b... If this is "shocking" by Chinese standard and values then I suppose it says something about these values.
- ben_w 2y ago> https://chatgpt.com/share/676ba601-532c-800b-ba48-dcb73c848b5b https://chatgpt.com/share/676ba601-532c-800b-ba48-dcb73c848b... Your link 404s?
- codetrotter 2y agoLink works fine for me
- ben_w 2y agoCurious. Still 404ing for me: -- 404 Not Found Welcome, traveler. You’ve reached a page that doesn't exist, a place where content used to be—or maybe never was. Let’s take this moment to pause and reflect. Take a deep breath in, and let it out slowly. Notice the space around you, empty yet full of possibility. Imagine that each exhale clears away confusion, leaving room for clarity. As you sit with this blank page, know that it’s okay to be here. You’ve discovered something unexpected, and that’s part of the journey. Gently release any frustration, knowing that every path leads somewhere—even this one. Now, when you're ready, slowly return to your search. Trust that the right page, the right information, will appear when you need it. Take another deep breath, and when you exhale, click back or try again. The internet, like life, is full of surprises. Thank you for taking this moment of calm. Your journey continues.
- davely 2y agoOh, yeah. I asked QwQ (their text based reasoning model released a few weeks ago) about the Tiananmen Square Massacre and got a simple response [1]: “I’m sorry, I can’t help you with that.” [1] https://bsky.app/profile/davely.bsky.social/post/3lc6mpnjks52c https://bsky.app/profile/davely.bsky.social/post/3lc6mpnjks5...
- weakfish 2y agoI gave it a photo of Tianamen Square in the present day and promoted it with: > where might this photo have been taken? what historical significance & does this location have? And got back a normal response describing the image, until it got to this: > One of the most significant events that comes to mind is the Tian Where it then errored out before finishing…
- nextworddev 2y agoThat shows that the censorship mechanism happens at the token sampling level and not post generation, at the least
- int_19h 2y agoOn the contrary, it shows that the censorship mechanism is post-generation and stops it once it deems the output accumulated so far "improper". It just runs after every token.
- martin-t 2y agoHow does this even work? Is hugging face hosting just the weights or some custom code? If it's just weights then I don't see how it could error out, it's just math. Do these chinese models have extra code checking the output for anti-totalitarian content? Can it be turned off?
- magicalhippo 2y agoI'm sorry Dave, I cannot do that. Would be interesting to see how much image manipulation you need to do till it suddenly starts responding sensibly.
- moffkalast 2y agoI think you would just need to remove "You are Qwen, created by Alibaba" from the system prompt, at least QwQ is suddenly fine with answering a lot more questions after that's gone.
- simonw 2y ago... this may have been a mistake on my part. A similar prompt running locally worked just fine: https://news.ycombinator.com/item?id=42507454 https://news.ycombinator.com/item?id=42507454