4 ms·
"Did you train the model using real world data?" "Yes. We want the model to be useful in real world applications." "Then it is biased. The model is biased b
by thesuperbigfrog 4y ago
"Did you train the model using real world data?"
"Yes. We want the model to be useful in real world applications."
"Then it is biased. The model is biased because data it was trained on was generated by people and people are biased. There is no such thing as an 'objective' model, just a model that is biased in a different way."
- kelseyfrog 4y agoYep. It's fundamentally impossible to create a LLM that isn't biased in the same way it's not possible to create any strand of interesting text that isn't also biased. It's simply not possible. Not for AI. Not for humans. I'd challenge anyone to attempt to try.
- throw9986bbdhi 4y agoThis is not really correct. Humans make systematic errors of judgement (bias), which is reflected in texts. But you could still imagine an AI unbiased, "perfectly modelling" this "biased" data (retrieving the "true model" behind this data). Not that I endorse this article either.
- thesuperbigfrog 4y ago> you could still imagine an AI unbiased, "perfectly modelling" this "biased" data Imagining something is different from building a working system. In beginning physics courses, students learn the fundamentals of Newtonian mechanics using frictionless point masses, but no one has built one for the students to use in the hands-on labs. If bias goes into a model through the training data, bias will come out when the model is used. The only unbiased models are untrained models, which are not very useful.
- Reefersleep 4y agoYour comment has me pondering. Is there such a thing as an unbiased human experience, let alone an unbiased human utterance? Everything we do is informed by the past, however indirectly and outwardly unpredictable.
- darthrupert 4y agoReality has a well-known liberal bias.
- kbelder 4y agoModern or classical?
- darthrupert 4y agoYes!