3 ms·
I found the question and answer weights as well as some primary source documents on the methodology in the court file. My interpretation is that this was not "
by apical_dendrite 2y ago
I found the question and answer weights as well as some primary source documents on the methodology in the court file.
My interpretation is that this was not "obviously designed to be gamed with secret information", it was just bad methodology. They had a goal of screening out 70% of applicants, but the remaining 30% of applicants needed to have a demographic balance that would not constitute a disparate impact, and they had to do this in a legally defensible way. Working backwards from that goal, they took biographical data that they had collected in the 80s and 90s and constructed a test program that, they believed, would give them the result they wanted. So if the answer weights are logically nonsensical, it's not because they were building in a secret password, it's because that's what happens when you build a model that's overfit on a small number of datapoints.
https://storage.courtlistener.com/recap/gov.uscourts.dcd.182656/gov.uscourts.dcd.182656.139.26.pdf https://storage.courtlistener.com/recap/gov.uscourts.dcd.182...
https://www.courtlistener.com/docket/4542755/139/24/brigida-v-united-states-department-of-transportation/ https://www.courtlistener.com/docket/4542755/139/24/brigida-...
- comeonbro 2y agoWow. I thought I remembered something like that but I thought it sounded too extreme and wouldn't be easily supportable, so I left it out of my other comment. So this test: 1) was designed to statistically select for members of favored identity groups and against members of disfavored identity groups, and not in any way to measure ATC job aptitude, resulting in highly-scored questions like "The high school subject in which I received my lowest grades was" where the only correct answer was "Science", and failing the test disqualified you permanently and 2) current FAA employees distributed the exact answer key to outside racial identity organizations to give to their members
- rayiner 2y agoWhat were they fitting for?