4 ms·

Pretty shameful for the programmers who implemented this.

umeshunni 5y ago
[flagged]
Kerrick 5y ago
I wouldn't be surprised if it was sold to programmers as a "dynamic block list" so they could respond to the changing landscape of slurs, and then execs decided to use that functionality to add these other words.
- buildbot 5y ago
  Which tangentially, is 100% why any Apple (Or other) engineer building "on device" CSAM scanner that is remotely update-able should think really hard...
- bushin 5y ago
  "It should be noted that no ethically-trained software engineer would ever consent to write a DestroyBaghdad procedure. Basic professional ethics would instead require him to write a DestroyCity procedure, to which Baghdad could be given as a parameter."
awb 5y ago
No programmers implemented this yet. > a planned internal messaging app > “This particular program has not been approved yet and may change significantly or even never launch at all.” > “If it does launch at some point down the road,” said the Amazon spokesperson, “there are no plans for many of the words you’re calling out to be screened. The only kinds of words that may be screened are ones that are offensive or harassing, which is intended to protect our team.”
- not2b 5y ago
  Apparently meaning: they were caught, so now they have to rethink it.
  - awb 5y ago
    Yeah, this leak is about a brainstorming session. It was a stupid suggestion that apparently hasn’t seen the light of day.
    - not2b 5y ago
      Looks like it went further than just a brainstorming session, because a list of words and phrases to be blocked was assembled and this is what leaked. It isn't clear whether or not they would have proceeded if there hadn't been a leak.
      - awb 5y ago
        > It isn't clear whether or not they would have proceeded if there hadn't been a leak. Right, just many folks on this thread like OC insinuating that it's already been built. I think asking why this idea got as far as it did is a valid question. I mean creating an app and filtering for profanity is standard. But then who hijacked the list and added pretty benign terms?
        not2b 5y ago
        Those aren't benign terms, because that kind of filtering might violate labor relations laws in the US, depending on the details.
        awb 5y ago
        Sorry, I mean benign in the sense of them not being vulgar or violent. They are still certainly important words.
alligatorplum 5y ago
This is pure speculation, but I wouldn't even be surprised if didn't have any say in this. What likely happened is that higher ups proposed a new feature to ban certain words, likely phrased as a way to remove racist and/or derogatory words.
- kqr 5y ago
  As a software engineer today, you always have a say in what work you perform with your own hands. You might think a big enough paycheck compensates for an ethical infraction, but it's a decision you alone make.
mypalmike 5y ago
Read the article. There was apparently a meeting where there was a discussion about whether free text should be allowed in a kudos-granting app. It's possible, even likely, that nobody has implemented anything.
brightstep 5y ago
What are they going to do? Refuse and lose their ridiculous salary? If only there were a way for workers to make a stand on this together, some kind of way to demands as a group.

[flagged]

I wouldn't be surprised if it was sold to programmers as a "dynamic block list" so they could respond to the changing landscape of slurs, and then execs decided to use that functionality to add these other words.

buildbot 5y ago
Which tangentially, is 100% why any Apple (Or other) engineer building "on device" CSAM scanner that is remotely update-able should think really hard...
bushin 5y ago
"It should be noted that no ethically-trained software engineer would ever consent to write a DestroyBaghdad procedure. Basic professional ethics would instead require him to write a DestroyCity procedure, to which Baghdad could be given as a parameter."

awb 5y ago

No programmers implemented this yet. > a planned internal messaging app > “This particular program has not been approved yet and may change significantly or even never launch at all.” > “If it does launch at some point down the road,” said the Amazon spokesperson, “there are no plans for many of the words you’re calling out to be screened. The only kinds of words that may be screened are ones that are offensive or harassing, which is intended to protect our team.”

not2b 5y ago
Apparently meaning: they were caught, so now they have to rethink it.
- awb 5y ago
  Yeah, this leak is about a brainstorming session. It was a stupid suggestion that apparently hasn’t seen the light of day.
  - not2b 5y ago
    Looks like it went further than just a brainstorming session, because a list of words and phrases to be blocked was assembled and this is what leaked. It isn't clear whether or not they would have proceeded if there hadn't been a leak.
    - awb 5y ago
      > It isn't clear whether or not they would have proceeded if there hadn't been a leak. Right, just many folks on this thread like OC insinuating that it's already been built. I think asking why this idea got as far as it did is a valid question. I mean creating an app and filtering for profanity is standard. But then who hijacked the list and added pretty benign terms?
      - not2b 5y ago
        Those aren't benign terms, because that kind of filtering might violate labor relations laws in the US, depending on the details.
        awb 5y ago
        Sorry, I mean benign in the sense of them not being vulgar or violent. They are still certainly important words.

alligatorplum 5y ago

This is pure speculation, but I wouldn't even be surprised if didn't have any say in this. What likely happened is that higher ups proposed a new feature to ban certain words, likely phrased as a way to remove racist and/or derogatory words.

kqr 5y ago
As a software engineer today, you always have a say in what work you perform with your own hands. You might think a big enough paycheck compensates for an ethical infraction, but it's a decision you alone make.

mypalmike 5y ago

Read the article. There was apparently a meeting where there was a discussion about whether free text should be allowed in a kudos-granting app. It's possible, even likely, that nobody has implemented anything.

brightstep 5y ago

What are they going to do? Refuse and lose their ridiculous salary? If only there were a way for workers to make a stand on this together, some kind of way to demands as a group.