4 ms·
> But somehow because a LLM is doing it, it becomes legal. IANAL, but I believe it does not. As it was famously said way back in the day, a computer can never
by drdaeman 2y ago
> But somehow because a LLM is doing it, it becomes legal.
IANAL, but I believe it does not. As it was famously said way back in the day, a computer can never be held accountable, therefore a computer must never make a management decision.
There is always a human in the loop who makes the actual decision (even if that's just a formality), and if this decision is based on a flawed computer's recommendation, the flaws still apply. I think it was repeatedly proven that "company's computer says so" is not a legal defense.
- sterlind 2y agoaren't credit score checks literally this? credit scores are assigned to you based on feeding your personal data into some proprietary model. that score determines whether you get a loan, or a job, or a security clearance. there are policies that use hard cut-offs. how is that not exactly this?
- consteval 2y agoIt is exactly that (basically), and there's numerous ethical arguments around credit score. But credit score was in a somewhat unique position, because what predated it was obvious racism, sexism, and other types of discrimination. For both companies and consumers, it was a step up. Now, I'm not sure if that's the case. Today there's still many legal and moral qualms about using credit score for job applicants. It's illegal in many areas and highly scrutinized if a company does this.
- drdaeman 2y agoWell, I haven't really kept track on this, but I believe some states (at least California and Illinois, I believe) prohibit use of credit scores for employment decisions, and I think there was some legislation banning this approved by the House but haven't passed Senate or something like that... So, yeah, you're right that it's an issue - and chances are we'll see a wider bans on this (governments are extremely slow).