7 ms·
How many bots are on Twitter? Question is tough to answer and misses the point
- vorpalhex 4y agoNieman misses the mark here. They are worried about some other fight - "authentic" vs "inauthentic". That's fine but not the issue at question.
- superjan 4y agoIt would be useful, in so many ways, when there would be a way to prove that you are a unique human being without revealing too much of your identity. An intermediary NGO could provide that, if they in turn integrate with national identity registrations (many countries have these for tax, healthcare and social security registrations. As a policy, it should only provide proof of existence, nationality and “over 18” as data points. It can help to solve problems with bots, account theft, as well as accountability for hate speech/intimidation (the system should allow law enforcement to reveal identities over which they have jurisdiction).
- ceeplusplus 4y agoThen you would just get something like this [1]. As long as the rewards from spam outweigh the cost of spam, people will try to spam. What I don't understand is that Google solved spam detection 10 years ago, yet Twitter somehow can't solve it. [1] https://www.youtube.com/watch?v=Y-W0CBOGnnI https://www.youtube.com/watch?v=Y-W0CBOGnnI
- jonathanstrange 4y agoI really wouldn't say that Google has solved spam detection. If you search for any kind of purchasable consumer product, the first page of results mostly contains spam blog entries of very low quality. Most of them are "10 best X" or, even more useless, "50 best X" lists with the advertised product(s) on top of the list. Some of them are clearly auto-generated and still often make it to the top 20 results. That's why many people including me nowadays search for "search term +reddit" when looking for product information. If you include Youtube under the label Google (i.e., Alphabet), it's even worse, there is tons of spam and deliberate political misinformation in the comment sections, although arguably most of these are probably generated by humans. For example, any TV report about Ukraine on Youtube is spammed with pro-Russian troll posts from St. Petersburg and likely hired posters from India. There is also lots of commercial spam in comments. So no, I don't think they've solved the problem. They're using captchas against bots and that's about it.
- mike_hearn 4y agoWeb spam is a separate problem to bot-driven spam posting on social media, despite using the same word. Spam is also not the same thing as posts you disagree with. I went to YouTube, searched for [ukraine war report] and picked the first result that came from TV news to try and check your claim [1]. The top comments are all clearly human, some are claiming to be Ukrainians, and are all anti-Russian. Regardless, your post is a good illustration of the problems with academic bot research. Although researchers claim to be researching spam bots, their methodologies are often defining any post they don't agree with politically as "spam" or from "bots". [1] https://www.youtube.com/watch?v=nx-6Y00MrFo https://www.youtube.com/watch?v=nx-6Y00MrFo
- jonathanstrange 4y agoNo, when I use the word "spam" I do not mean "posts I disagree with", I was referring to posts that are deliberately intended to misinform, are repetitive, or are intended to lure people somewhere else, and are posted by people who are paid to do that or by bots. It is false to assume that these type of posts and associated accounts cannot be detected or do not exist. I agree that spam by bots differs from spam by humans. However, they need to be dealt with in union because they usually go hand in hand, i.e., bot nets often support and amplify select human posts and the human origins of these networks can be mapped and traced back to particular actors and sources. I doubt anybody would disagree with your general claim that there can be methodological problems with detecting any kind of spam, whether by bots or by humans. Of course, that's difficult, especially for researchers with only limited or no access to sensitive account information such as creation date, post history, IP numbers. If it was easy, then the spam problem would have been solved already, but I have argued that Google hasn't solved it.
- mike_hearn 4y ago"I was referring to posts that are deliberately intended to misinform" But how do you know they're misinformed/intending to misinform, unless you disagree with the post?
- Decker87 4y agoVery useless article. "It's hard to count them, so let's just acknowledge the difficulty of the problem instead of solving it."
- FargaColora 4y agoI was puzzled why the premise of the controversial headline was so flimsy, until I noticed halfway down the page that I was being sold a product.
- pixxel 4y agoI picked a random news org. and scrolled through their feed. It was The New York Times with 53 million followers. Scroll through their last 100 tweets or so and look at the engagement. 5-50 comments, 20-200 retweets. I used to get that level of engagement back in the day when I used Twitter with a couple thousand followers. Something’s off. Note. I’m not American and have no political affiliation to have selected NYT. EDIT: this was before the shooting that's just happened.
- deleted 4y ago[deleted]
- serial_dev 4y agoTwitter (used to?) recommend accounts to follow (I remember Obama, Shakira, WaPo, and I'm sure NYT) when you sign up with a new account, and those accounts probably have highly inflated number of followers with extremely low engagement (new users don't always stock around).
- ProfXponent 4y agoRecently created an alt account and they still do this. It was mostly “influencers”. One thing I have noticed is that Twitter REALLY wants me to follow Elon Musk. He’s at the top of pretty much every recommendation I’ve seen on the site.
- blitzar 4y agoWho comments or retweets news headlines? There is nobody on the other side of the account who is going to engage with you - the accounts are literally bots that publish the headlines from their feed. Lots of people follow the news / latest most followed celebrity account and dont engage with that person at all.
- throwaway0x7E6 4y agoapparently that's "normal" for New York Times in particular check out the views to comments ratio on this https://www.youtube.com/watch?v=K4II9cYrQvE https://www.youtube.com/watch?v=K4II9cYrQvE
- JumpCrisscross 4y ago"...it is important to be clear here that Musk is lying. The spam bots are not why he is backing away from the deal, as you can tell from the fact that the spam bots are why he did the deal. He has produced no evidence at all that Twitter’s estimates are wrong, and certainly not that they are materially wrong or made in bad faith. (Musk can only get out of the deal if Twitter's filings are wrong in a way that would cause a 'material adverse effect' on Twitter, which is vanishingly unlikely.) His own supposed methodology for counting spam bots is laughable. Yesterday Twitter’s chief executive officer, Parag Agrawal, tweeted a thread explaining in general terms how Twitter estimates that fake accounts represent fewer than 5% of its count of active users, and how this analysis can’t be easily replicated by outsiders (because they don’t know which accounts are real, and also because they don’t know which accounts Twitter counts as daily active users). It seems clear that Agrawal’s thoughtful answer is basically correct. Musk responded with a poop emoji. More important, nothing has changed about the bot problem since Musk signed the merger agreement. Twitter has published the same qualified estimate — that fewer than 5% of monetizable accounts are fake — for the last eight years. Musk knew those estimates, and declined to do any nonpublic due diligence before signing the merger agreement. He knew about the spam bot problem before signing the merger agreement, as we know because he talked about it constantly, including while announcing the merger agreement. If he didn’t want to buy Twitter because there are spam bots, he should not have signed a contract to buy Twitter. No new information has come to light about spam bots in the last three weeks. What has happened in the last three weeks? Well, the prices of tech stocks have gone down, making the $54.20 price that Musk agreed to look a bit rich. (Snap Inc., a social-media competitor to Twitter, is down more than 30% since Musk made his offer on April 13.) And the price of Tesla Inc. stock, which he is relying on to finance part of the purchase price, has also gone down, making him poorer and making the $54.20 price look even more expensive. (Tesla is down almost 30% since he made his offer.) So he is angling to reprice the deal for straightforward market reasons. But that is very clearly not allowed by the merger agreement that he signed: Public-company merger agreements allocate broad market risk to the buyer, and he can’t get out just because stocks went down. So he is pretending that he wants to reprice the deal for other reasons. He is not pretending very hard — the poop emoji is not going to hold up in court! — but he’s doing enough to confuse the public and give his fans a pretext to believe that he is really the victim here." Twitter's Board are a clown car. [1] https://www.bloomberg.com/opinion/articles/2022-05-17/elon-musk-does-not-care-about-spam-bots https://www.bloomberg.com/opinion/articles/2022-05-17/elon-m...
- aufhebung 4y agoIsn't the number of bots primarily relevant to advertisers? This article entirely misses why the question is even worth asking.
- divbzero 4y agoThe number of bots misses the point for advertising too. If a company spends $X on Twitter ads and measures a boost of $Y in sales from Twitter leads, how many humans vs bots viewed the ads is neither here nor there. That said, the question is certainly worth asking beyond the realm of advertising. Media has a significant impact on people and society beyond its profitability.
- bogantech 4y agoIt depends on whether you're paying per impression or per conversion. If you pay an advertising company a rate per view and the advertising company charges you knowing that a large percentage of those "views" were fake then you're being ripped off.
- ALittleLight 4y agoWell, that depends. If I pay X per 1k views what I care about is how much I sell as a result of that. If I sell a lot and profit would I care that some huge percentage of my views were bots? Conversely, if I sell very little would I care that there were zero bots? If you are advertising just to get an idea out, or for something you have no capacity to measure, sure. You need to know accurate numbers. But if you can track conversions on your end, and conversions are good, does the exact number of real views really matter?
- nrb 4y agoOf course it matters if you’re being billed by the impression! No matter how good your conversions might be, your margin would be unquestionably higher without the fraudulent impressions.
- kkfx 4y agoThe point is: Twitter is useful for who? For users I see nothing useful. For third party using users tweets to get live coverage of something a little use. For human network and mud analysis by Twitter owners and those who buy/commission such studies a significant use. So the point is: WHY THE HELL so many people want to work for free mostly against their own interests spending time on the platform? That's an interesting point because having flock of humans (sorry for being so rude, but that's is) willing to work for free for someone else interests is VERY interesting... I have many things I'd like to outsource for free to third parties willing to work gratis for me. Just basic stuff eh! Who want to came at my home to clean it up regularly for free or even pay for being allowed to clean up more regularly?
- aronhegedus 4y ago""" The focus of the recent debate on estimating the number of Twitter bots oversimplifies the issue and misses the point of quantifying the harm of online abuse and manipulation by inauthentic accounts. """ This article is missing the point. The reason Musk wants to know how many bots there are is because a lot of the advertising revenue isn't "pay per click" ads, but just companies advertising for more eyes to see it. In that case, companies aren't going to pay if it's not real human eyes seeing it bit of clickbait
- RugnirViking 4y ago> The reason Musk wants to know Musk wants to know so he doesn't have to pay the price he agreed to pay given the entire tech stock market just took like a 50% hit. It's nothing to do with bots and everything to do with getting out of the deal/getting a more sane price and honestly fair enough I wouldn't want to massively overpay for something like that either.
- shapefrog 4y agoAre bots not entitled to free speech as well?
- Dave3of5 4y agoYeah clickbait. The issue with bots comes down to the valuation of twitter end of story. Musk wants to bring that valuation down and he's using bots as a method to do that. To be honest he does have a point (I hate this) as I could easily create and app with 500 bot users and 50 real users. Selling it for if I had 550 is really scummy.
- belter 4y agoIs ironic because one of the reasons he public stated to buy Twitter, was to end with the bots.
- mike_hearn 4y agoThe Botometer guys need to give this up. They've been doing this for years yet their models lack credibility, having been subject in the past to 50%+ false positive rates which were never acknowledged. Instead they silently hard-coded their websites to fix the particular examples being used to prove FPs (their methodologies are never replicable, so a black box API is all you get). When you sit down and read these papers you find the whole field of academic bot research is just ideologically motivated quackery. It isn't taken seriously by anyone who actually works in the spam fighting industry, but does harm the overall credibility of science. If these people actually want to work on bot fighting (like I did) they need to quit academia and go apply for jobs at tech firms. Anything they try produce externally will be noise, because as they acknowledge: "External researchers do not have access to the same data as Twitter, such as IP addresses and phone numbers. This hinders the public’s ability to identify inauthentic accounts." It doesn't hinder it, the lack of such basic signals makes it impossible, which is one of several reasons their studies keep yielding junk-quality results. Further reading: https://blog.plan99.net/fake-science-part-ii-bots-that-are-not-c66129e5e3f5 https://blog.plan99.net/fake-science-part-ii-bots-that-are-n... https://blog.plan99.net/did-russian-bots-impact-brexit-ad66f08c014a https://blog.plan99.net/did-russian-bots-impact-brexit-ad66f... https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3814191 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3814191 https://archive.org/details/hopeconf2020/20200726_2000_People_Are_Not_Bots.mp4 https://archive.org/details/hopeconf2020/20200726_2000_Peopl...
- aaron695 4y ago
- h2odragon 4y agoSo I forget: Are masses of Russian bots spewing disinformation still swaying public opinion on important issues? Or has there been acknowledgement that that never really happened?