3 ms·

LLMs are notoriously bad at dealing with pronouns, because it's not correct to blindly copy them like other nouns, and instead they highly depend on the context

by o11c 1y ago

LLMs are notoriously bad at dealing with pronouns, because it's not correct to blindly copy them like other nouns, and instead they highly depend on the context.

aaronbrethorst 1y ago
[flagged]
- turing_complete 1y ago
  'It' is obviously the correct pronoun.
  - celdon25 1y ago
    You’re not aligned bro. Get with the program.
  - mylidlpony 1y ago
    [flagged]
  - jsnider3 1y ago
    There's enough disagreement among native English speakers that you can't really say any pronoun is the obviously correct one for an AI.
    - Wowfunhappy 1y ago
      "What color is the car? It is red." "It" is unambiguously the correct pronoun to use for a car. I'd really challenge you to find a native English speaker who would think otherwise. I would argue a computer program is no different than a car.
      - olddustytrail 1y ago
        People often refer to their car and other people's as "she" ("she's a beauty") so you're is obviously wrong.
        Wowfunhappy 1y ago
        But no one who does that thinks they're using proper English!
        jhugo 1y ago
        "she" is absolutely proper English for a ship or boat, with a long history of use continuing into the present day, and many dictionaries also list a definition of "thing, especially machine" or something like that, though for non-ship/boat things the use of "she" is rather less common.
- zahlman 1y ago
  I'm not especially surprised. Surely people who use they/them pronouns are very over-represented in the sample of people using the phrase "I use ___ pronouns". On the other hand, Claude presumably does have a model of the fact of not being an organic entity, from which it could presumably infer that it lacks a gender. ...But that wasn't the point. Inflecting words for gender doesn't seem to me like it would be difficult for an LLM. GP was saying that swapping "I" for "you" etc. depending on perspective would be difficult, and I think that is probably more difficult than inflecting words for gender. Especially if the training data includes lots of text in Romance languages.

by o11c 1y ago

LLMs are notoriously bad at dealing with pronouns, because it's not correct to blindly copy them like other nouns, and instead they highly depend on the context.

aaronbrethorst 1y ago

[flagged]

turing_complete 1y ago
'It' is obviously the correct pronoun.
- celdon25 1y ago
  You’re not aligned bro. Get with the program.
- mylidlpony 1y ago
  [flagged]
- jsnider3 1y ago
  There's enough disagreement among native English speakers that you can't really say any pronoun is the obviously correct one for an AI.
  - Wowfunhappy 1y ago
    "What color is the car? It is red." "It" is unambiguously the correct pronoun to use for a car. I'd really challenge you to find a native English speaker who would think otherwise. I would argue a computer program is no different than a car.
    - olddustytrail 1y ago
      People often refer to their car and other people's as "she" ("she's a beauty") so you're is obviously wrong.
      - Wowfunhappy 1y ago
        But no one who does that thinks they're using proper English!
        jhugo 1y ago
        "she" is absolutely proper English for a ship or boat, with a long history of use continuing into the present day, and many dictionaries also list a definition of "thing, especially machine" or something like that, though for non-ship/boat things the use of "she" is rather less common.
zahlman 1y ago
I'm not especially surprised. Surely people who use they/them pronouns are very over-represented in the sample of people using the phrase "I use ___ pronouns". On the other hand, Claude presumably does have a model of the fact of not being an organic entity, from which it could presumably infer that it lacks a gender. ...But that wasn't the point. Inflecting words for gender doesn't seem to me like it would be difficult for an LLM. GP was saying that swapping "I" for "you" etc. depending on perspective would be difficult, and I think that is probably more difficult than inflecting words for gender. Especially if the training data includes lots of text in Romance languages.