4 ms·
Maybe the way to explain an LLM to the general public is to think of it as a child. The words that child learns and uses come somewhat from their parents. If th
by tppiotrowski 3y ago
Maybe the way to explain an LLM to the general public is to think of it as a child. The words that child learns and uses come somewhat from their parents. If the parents are fighting and saying f** and b**, the kid will learn those words. If they hear a catchy phrase in a cartoon, they'll repeat it. If their parents discuss how much they hate a certain person or issue, the kid will probably adopt those beliefs. And if their parents have CNN or Fox News playing in the background will also have an effect on the thoughts that child produces.
An LLM is just a product of its environment, mostly published books and the Internet. This content is skewed to being produced by the bourgeois. If we put a microphone on everyone from birth and feed it to an LLM, we'd get a more diverse output but we're not there yet.
- steveBK123 3y agoPrecisely. And each org may have slightly different biases in which training data they feed into their system!
- binary132 3y agoPeople need to be willing to recognize and admit that this is not an “oopsie data bias” problem. It’s “feature working as intended”.
- appplication 3y agoReading your comment “feature working as intended”, I can’t tell if that’s supposed to be conspiratorial or just blunt. I think the linked twitter images tell a pretty reasonable story. Sure, you could argue the model appears biased against some conservative media, but I think the reality is that it is a self-inflicted wound from conservative media’s general lack of editorial standards.
- kvee 3y agoIt does seem actually to be "feature working as intended" if you read the initial Gemini paper. Some relevant concerning stuff pulled from it here: https://twitter.com/psychosort/status/1760849091171352956 https://twitter.com/psychosort/status/1760849091171352956 https://twitter.com/psychosort/status/1761044625307963445 https://twitter.com/psychosort/status/1761044625307963445 Paper itself here: https://storage.googleapis.com/deepmind-media/gemini/gemini_1_report.pdf https://storage.googleapis.com/deepmind-media/gemini/gemini_...
- kortilla 3y agoYes, this is why hitler and Elon are basically the same… editorial standards
- solobalbo 3y agoWow