3 ms·
if it takes 1 hour to get one answer by hand, but only 20 minutes for the machine, and 20 minutes to check the answer, the user still comes out ahead
by fragmede 3y ago
if it takes 1
hour to get one answer by hand, but only 20 minutes for the machine, and 20 minutes to check the answer, the user still comes out ahead
- nicklecompte 3y agoThose numbers are arbitrary and fictional, and the more relevant made-up quantity would be the variance rather than the mean. It doesn't really matter if the "average user" saves time over 10,000 queries. I am much more concerned about the numerous edge cases, especially if those cases might be "edge fields" like animal cognition (see below). In my experience it takes quite a bit longer to falsify GPT-4's incorrect answers than it does to a Google search and get the right answer. It might take 30 seconds to check a correct answer (jump to the relevant paragraph and check), but 30 minutes to determine where an incorrect answer actually went wrong (you have to read the whole paper in close detail, and maybe even relevant citations). More specifically, it is somewhat quick to falsify something if it is directly contradicted by the text. It is much harder to falsify unsupported generalizations or summaries. As a specific example, I recently asked GPT for information on arithmetic abilities in amphibians. It made up a study - that was easy to check - but it also made up a bunch of results without citing specific studies. That was not easy to check[1]: each paragraph of text GPT generated needed to be cross-checked with Google Scholar to try and find a relevant paper. It turned out that everything GPT said, over 1000 words of output, was contradicted by actual published research. But I had to read three papers to figure that out. I would have been much better off with Google Scholar. But I am concerned that a large minority of cynical, lazy people will say "90% is good enough, I don't want to read all these papers and nobody's gonna check the citations anyway" and further drag down the reliability of published research. [1] This was a test of GPT. If I were actually using it for work, obviously I would have stopped at the fake citation.
- throwup238 3y agoThis is impacting online discourse too. It used to be that when someone is wildly wrong it was relatively easy to identify why: ideology, common urban myth, outdated research, whatever. Now? I’ve seen people argue positions that are demonstrably wildly wrong in unusually creative and often subtle ways and there’s no way to figure out where they went off the rails. Since the LLM is responsive, they can use it to come up plausibly sounding nonsense to answer any criticisms collapsing the debate into a black hole of bullshit.
- jamesbrady 3y agoElician here! Thanks for your comment. I'm not sure I agree that those rule-of-thumb statistics are "arbitrary" or "fictional"… I guess it depends on what you mean by that. I can say that on our part they're a good faith attempt to help users calibrate how best to use the tool, using evaluations of Elicit based on real usage. Definitely accept that the tool can work better or worse depending on your domain or workflow though! One way we do try to distinguish ourselves from vanilla LLMs is that we provide sources for all of the claims made. I mention this because we hope our users can approach the falsification process you mention for Google. We want to show people where particular claims come from such that we earn their trust. Walking citation trails and verifying transitive claims is something we've talked about but need more people to implement! (https://elicit.com/careers https://elicit.com/careers)
- nicklecompte 3y ago> I'm not sure I agree that those rule-of-thumb statistics are "arbitrary" or "fictional"… I guess it depends on what you mean by that. Sorry for the confusion: I meant that fragmede's comment was arbitrary and fictional, not the 90% figure. I was talking about these numbers: if it takes 1 hour to get one answer by hand, but only 20 minutes for the machine, and 20 minutes to check the answer, the user still comes out ahead
- jamesbrady 3y agoOh, my bad—I misunderstood, thanks for the clarification
- tivert 3y ago> if it takes 1 hour to get one answer by hand, but only 20 minutes for the machine, and 20 minutes to check the answer, the user still comes out ahead IF the machine actually got it right.
- ben_w 3y agoIf it's right 90% of the time, with those other assumptions, then you either: 1) spend 10 hours doing all of them by hand 2) spend 3h 20 waiting for the machine, 3h 20 checking the machine, and 1h replacing the machine's mistake with a hand-written version, for a total of 7h 40 (I never trust marketing claims, so I doubt 90% accuracy; but also it generally takes LLMs a few seconds rather than tens of minutes to produce an output to be checked).
- tivert 3y agoThere's also the issue where if you aren't doing the work much anymore, will you continue to be able to competently check its output? Be able to intervene as well when it makes a mistake? I think it's tempting but oversimple to focus on "output" and "time saved generating it," but that misses all the other stuff that happens while doing something, especially when it's a "softer" task (vs. say, mechanical calculation). It also seems like a mindset focused on selling an application rather than doing a better job.
- ben_w 3y agoSure, but that's part of a much broader issue that predates AI by at least two millennia, probably much longer — the principal-agent problem.
- tivert 3y ago> Sure, but that's part of a much broader issue that predates AI by at least two millennia, probably much longer — the principal-agent problem. I don't think that captures what I'm thinking about, which is more skills atrophy ("Children of the Magenta") problem than a conflict of interest problem. https://www.computer.org/csdl/magazine/sp/2015/05/msp2015050104/13rRUxASutL https://www.computer.org/csdl/magazine/sp/2015/05/msp2015050... > William Langewiesche's article analyzing the June 2009 crash of Air France flight 447 comes to this conclusion: “We are locked into a spiral in which poor human performance begets automation, which worsens human performance, which begets increasing automation” (www.vanityfair.com/news/business/2014/10/air-france-flight-447-crash). > ... > Langewiesche's rewording of these laws is that “the effect of automation is to reduce the cockpit workload when the workload is low and to increase it when the workload is high” and that “once you put pilots on automation, their manual abilities degrade and their flight-path awareness is dulled: flying becomes a monitoring task, an abstraction on a screen, a mind-numbing wait for the next hotel.”