3 ms·
My interpretation of a lot of this stuff in the popular LLMS is that the training data itself (as chosen by the org) has its own biases, and then the orgs thems
by steveBK123 3y ago
My interpretation of a lot of this stuff in the popular LLMS is that the training data itself (as chosen by the org) has its own biases, and then the orgs themselves are applying their own biases via the system prompts on top. Some of those biases move in the same direction, some move in the opposite direction.
Googles seemed specifically one directional.
Some of this is also I think just buggy/poorly tested system prompts & guardrails that people in the Bay Area Bubble working on it don't catch themselves. That is, many of these issues are only identifiable by ideologically diverse testers.
- binary132 3y agoHow do you suggest ideological diversity be designed? Ideological anarchy won’t be accepted. Neither will whitewashed center-party ideological conformity. The reality is that some of these ideologies are inextricably locked in mortal conflict against one another. Some of them consciously seek to undermine, subvert, or supersede one another. It’s not that simple.
- jaywee 3y agoHave multiple explicit ones. One liberal, one conservative, one progressive...
- brigadier132 3y agoPretty much every other llm has managed to thread this line without releasing a model that's extremely dystopian.