3 ms·

Thanks for the paper! I'll be looking into it. The reason I'm bringing this up is that these issues, in humans, are solved by redundency (i.e. hiring someone e

by dmbche 4y ago

Thanks for the paper! I'll be looking into it. The reason I'm bringing this up is that these issues, in humans, are solved by redundency (i.e. hiring someone else to look over their work). As long as errors persist and, more importantly, are impossible/hard to be warned of, competent humans will need to oversee and validate every word they type, making their "advantage" much more nuanced. It kind of turns into having a friend that can google pretty well answer your questions. I'm not an expert, feel free to show me wrong - I'm reading the paper now and expecting it to be at least a touch troubling :)

MacsHeadroom 4y ago
There's another paper which showed GPT-4 (or was it 3.5?) going from something like 78% to 99.9% success on difficult multi-part reasoning tasks by running two copies of itself where one is an editor/reviewer. I'm on my phone at the moment. But maybe someone else can link it.
p-e-w 4y ago
> As long as errors persist and, more importantly, are impossible/hard to be warned of, competent humans will need to oversee and validate "Competent" humans make errors too. This is a non-argument.