3 ms·
False positives don't seem overly harmful here either, since the main use would be bringing it to human attention for further thought
by rokkamokka 2y ago
False positives don't seem overly harmful here either, since the main use would be bringing it to human attention for further thought
- wizzwizz4 2y agoIs there advantage over just reviewing papers with a critical eye?
- jeffbee 2y agoIf reviewer effort is limited and the model has at least a bias in the right direction.
- wizzwizz4 2y agoSo I just need to make sure my fraud goes under the radar of these AI tools, and then the limited reviewer effort will be spent elsewhere.
- estarkio 2y agoI think some people will find an advantage in flagging untold numbers of research papers as frivolous or fraudulent with minimal effort, while putting the burden of re-proving the work on everyone else. In other words, I fear this is a leap in Gish Gallop technology.
- Zigurd 2y agoThere's probably 10 X more problematic academic publications, than currently get flagged. Automating the search for the likeliest candidates is going to be very helpful by focusing the "critical eye" where it can make the biggest difference.
- epidemiology 2y agoThe largest problems with most publications (in epi and in my opinion at least) is study design. Unfortunately, faulty study design or things like data cleaning is qualitative, nuanced, and difficult to catch with AI unless it has access to the source data.
- AlienRobot 2y agoHopefully, one would use this to try to find errors in a massive number of papers, and then go through the effort of reviewing these papers themselves before bringing up the issue. It makes no sense to put effort unto others just because the AI said so.
- nyrikki 2y agoWalking through their interface, it seems like when you click though on the relatively few that aren't just tiny spelling/formatting errors, Like this style: > Methodology check: The paper lacks a quantitative evaluation or comparison to ground truth data, relying on a purely qu... They always seem to be edited to be simple formatting errors. https://yesnoerror.com/doc/eb99aec0-a72a-45f7-bf2c-8cf2cbab1f4a https://yesnoerror.com/doc/eb99aec0-a72a-45f7-bf2c-8cf2cbab1... If they can't improve that the signal to noise ratio will be to high and people will shut it off/ignore it. Time is not free, cost people lots of time without them seeing value and almost any project will fail.