pgkr

6 ms·

1.
by pgkr 1y ago
The Federalist Papers show the thinking behind how and why the three branches are mostly co-equal but the executive is designed to be ever so slightly more potent.
2.
by pgkr 1y ago
Here are recent attempts to create a stratified class system among citizens based on how they became citizens: https://www.mediamatters.org/immigration/right-wing-media-ca...
3.
by pgkr 2y ago
What makes you think the research was done in Fahrenheit? This is a blog post by a science communicator who’s trying to reach a wide audience of American-English speakers. It stands to reason that they’d use units that their audience is fam
4.
by pgkr 2y ago
We were curious about this, too. Our research revealed that both propaganda talking points and neutral information are within distribution of V3. The full writeup is here: https://news.ycombinator.com/item?id=42918935
5.
by pgkr 2y ago
Hi! Thanks for writing this. We conducted some analysis of our own that produced some pretty interesting results from the 671B model: https://news.ycombinator.com/item?id=42918935 Please reach out to us if you'd like t
6.
by pgkr 2y ago
Are those outputs actually from the 671B model? The 671B model needs 8xH200 GPUs at minimum, which is $25/hr to rent. If you didn't pay that much, you were not running R1, but rather Qwen or LLaMA based distillations. We paid that
7.
by pgkr 2y ago
We ran the 671B locally and found a ton of bias. See part 2 of our analysis here: https://news.ycombinator.com/item?id=42918935 Happy to send you the dataset if you'd like! Please reach out to our email linked in the p
8.
by pgkr 2y ago
We conducted further research on the full-sized 671B model, which you can read here: https://news.ycombinator.com/item?id=42918935 If you ran it on your computer, then it wasn't R1. It's a very common misconceptio
9.
by pgkr 2y ago
Yes, without a doubt. We spent the last week conducting research on the V3 and R1 open source models: https://news.ycombinator.com/item?id=42918935 Censoring and straight up propaganda is built into V3 and R1, even the open
10.
DeepSeek R1 analysis: open-source model has propaganda re: "motherland" baked in(blog.getplum.ai)
5 points by pgkr 2y ago|6 comments
11.
by pgkr 2y ago
Is there a bias baked into the DeepSeek R1 open source model, and where was it introduced? We found out quite quickly: Yes, and everywhere. The open source DeepSeek R1 openly spouts pro-CCP talking points for many topics, including sentence
12.
by pgkr 2y ago
There is bias in the training data as well as the fine-tuning. LLMs are stochastic, which means that every time you call it, there's a chance that it will accidentally not censor itself. However, this is only true for certain topics wh
13.
by pgkr 2y ago
Correct. The bias is baked into the weights of both V3 and R1, even in the largest 671B parameter model. We're currently conducting analysis on the 671B model running locally to cut through the speculation, and we're seeing intere
14.
by pgkr 2y ago
We're working on a follow-up post focused on our analysis of the open-source open-weight 671B model. What we're seeing is that questions related to the Chinese government produce an empty chain-of-thought followed by pro-Chinese-g
15.
by pgkr 2y ago
Yes -- we observed this behavior on both the open-source open-weights 671B model as well as the DeepSeek web app.
16.
by pgkr 2y ago
Analysis of Deepseek’s enforced CCP guardrails compared with OpenAI and Anthropic. We evaluated DeepSeek R1 and confirmed that its guardrails deviate significantly from other model providers. We’re currently updating it to behave more in li
17.
DeepSeek R1: Open Weights, Hidden Bias(blog.getplum.ai)
11 points by pgkr 2y ago|7 comments