3 ms·
The Botometer guys need to give this up. They've been doing this for years yet their models lack credibility, having been subject in the past to 50%+ false posi
by mike_hearn 4y ago
The Botometer guys need to give this up. They've been doing this for years yet their models lack credibility, having been subject in the past to 50%+ false positive rates which were never acknowledged. Instead they silently hard-coded their websites to fix the particular examples being used to prove FPs (their methodologies are never replicable, so a black box API is all you get).
When you sit down and read these papers you find the whole field of academic bot research is just ideologically motivated quackery. It isn't taken seriously by anyone who actually works in the spam fighting industry, but does harm the overall credibility of science. If these people actually want to work on bot fighting (like I did) they need to quit academia and go apply for jobs at tech firms. Anything they try produce externally will be noise, because as they acknowledge:
"External researchers do not have access to the same data as Twitter, such as IP addresses and phone numbers. This hinders the public’s ability to identify inauthentic accounts."
It doesn't hinder it, the lack of such basic signals makes it impossible, which is one of several reasons their studies keep yielding junk-quality results.
Further reading:
https://blog.plan99.net/fake-science-part-ii-bots-that-are-not-c66129e5e3f5 https://blog.plan99.net/fake-science-part-ii-bots-that-are-n...
https://blog.plan99.net/did-russian-bots-impact-brexit-ad66f08c014a https://blog.plan99.net/did-russian-bots-impact-brexit-ad66f...
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3814191 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3814191
https://archive.org/details/hopeconf2020/20200726_2000_People_Are_Not_Bots.mp4 https://archive.org/details/hopeconf2020/20200726_2000_Peopl...