4 ms·
It’s good and cheap, but don’t talk about politics to it or it might trigger some sort of censorship rule. You can see it think, then suddenly erase everything
by abyssin 4mo ago
It’s good and cheap, but don’t talk about politics to it or it might trigger some sort of censorship rule. You can see it think, then suddenly erase everything and suggest to switch to another subject, without explaining anything. I also had it output some sort of generic message about how the news outlets are in the service of the people. Both times I was surprised because I didn’t make any sensitive requests, neither illegal nor subversive. But it was a remotely political topic and it was enough. There was something both chilling and refreshing about it, since censorship in the west is usually more subtle.
- ux266478 4mo agoThe base model doesn't have these problems FWIW
- cosmojg 4mo agoHow are you running the base model?
- ux266478 4mo agovLLM in a docker container, FP16 quantized on an 8x MI300X cluster. Very lazy hackjob, I didn't even set up an interface. Was constructing curl commands from string templates. I worked out if I paid that compute cost over a whole month, it was twice as expensive as the monthlies you'd pay for owning a very nice 2000sqft non-coop apartment in Midtown Manhattan. I was paying rock bottom prices, too.
- joewhale 4mo agodo most people use llms to chat about politics?
- customguy 4mo ago"do most people use llms to chat about [specific thing]?" No, of course not, why do you ask?
- true_religion 4mo agoI once was doing unrelated work to politics, but Qwen3 said that my input had homonym characters to those in the name of Xi Jimping. It gave the strangest response twice before finally admitting the source of the error and allowing me to convince it that no, I was not trying to intentionally misspell the man’s name.
- pton_xd 4mo agoHow is the censorship when asking for "dangerous" actions like writing a port scanner?