11 ms·
Because information curated by an AI with validation by a subject matter expert is worth significantly more than that which was done without a human in the loop
by celestialcheese 3y ago
Because information curated by an AI with validation by a subject matter expert is worth significantly more than that which was done without a human in the loop. There's no determinism with these systems, and from experience with GPT-4 doing classification tasks, it'll do everything exactly right until it doesn't.
If it's like many businesses in the classification world, they aren't lacking for work, so it's more like they'll be able to do 10x the work done by keeping the same number of people.
- eropple 3y ago90% quality for 10% the price means that most decisionmakers will--and they don't need to collude to do this--take that and pocket the difference. Why would 50% for 0.1% be different? 30% for 0.01%? This is the enshittification spiral to which I refer.
- celestialcheese 3y agoNot if the output quality matters - which in medical and biological classification tasks, quality labeling really really does matter. Garbage in, garbage out. If I was paying someone for labeling or classification, and the quality dropped to 90%, 50%, 30% accuracy, I'd quickly fire them.
- benatkin 3y agoWhat's your idea of "subject matter expert"? The term is used in court. Mine would probably include no more than double the number of people with doctorate degrees. It wouldn't include Priya right now, maybe after more education and/or a few years of exceptional experience.