2 ms·
Agreed, about the widespread misunderstanding of what LLMs are/aren't. Treating probabilistic models as decision engines is an error, and I think you're right a
by imadatalla 11mo ago
Agreed, about the widespread misunderstanding of what LLMs are/aren't. Treating probabilistic models as decision engines is an error, and I think you're right about liability issues.
Especially concerning that, even with those limitations, these systems are already being deployed inside workflows that influence decisions... I assume hiring (and maybe firing down the road?), content moderation, surveillance, targeting, triage. It's often done with the assumption that "the model is good enough" or that human oversight will catch errors later. In practice, that oversight tends to erode once systems scale.
Wondering how organizations are handling that gap: what the models can do vs. what they're implicitly trusted to do once integrated into real systems.
- jqpabc123 11mo agoWondering how organizations are handling that gap Similar to the way management handles most things (in the USA at least) --- by going with the flow until the error and pain of doing so becomes unbearable.
- imadatalla 11mo agoThe asymmetry of it all rings true: the "unbearable pain" shows up first (and sometimes instantly) for people on the receiving end of automated decisions, long before it's felt by system deployers -- a CV silently filtered out by automation, or a person physically or virtually canceled by an automated drone. By the time incentives flip for deployers, the workflows are already entrenched.