16 ms·
- announced at 10pm - basically a week to decide what to do with your dev project - No information to help you make that decision This seems like more manageme
by anigbrowl 4y ago
- announced at 10pm
- basically a week to decide what to do with your dev project
- No information to help you make that decision
This seems like more management by manchild. I strongly suspect that Musk realized his promises of cutting down bots etc. were failing and that they either couldn't or wouldn't develop abuse detection, so he's decided to solve the problem by making it cost money, with the (perhaps desired) side effect of crippling academic/analytic research.
As an amateur network science researcher, I'm pretty steamed. I enjoy doing my own network analyses using tools like Gephi and have monitored probably a hundred breaking news or trending issues, as well as amassing a great collection of academic papers by smarter folk than me. I don't run any kind of app or service that sits on top of Twitter, but those who do run legitimate services are now being held hostage because of the unchecked abuse. Ant the failure to deal with botspam is lamentable. Twitter has refused for years to implement even the simplest things like hashing tweets and looking for collisions, or considering the count of edges to the hashtag graph, or even looking at tweet frequency. Many of their abuse problems will continue unabated; the sellers in the market for bogus twitter accounts are likely delighted because they now have a great excuse to raise prices, even though most of their 'product' is produced by hand with cheap labor in poor countries.
- HWR_14 4y agoMusks promises of cutting down on bots only mattered to him and to the degree he made a big deal about it. He could have declared victory whenever and been done with it. Who would have argued.
- encryptluks2 4y agoI would have because all his posts are still full of bot spam and crypto scams... But, he certainly has no shortage of bots that upvote and call him king.
- anigbrowl 4y agoI think people would have argued with him. There are people that fawn on him one day and then complain that 'the algorithm has shadowbanned them again' the next, and he spends a surprising amount of time engaging with them. It's like some weird parody of an abusive relationship, with the world's erstwhile richest man and uber-CEO earnestly and repeatedly appeasing influencers like 'Catturd.' To an extent I think this is political theater, as opposed to ineptitude, petulance, or poor financial decision-making. Twitter is an important piece of virtual territory because it's still the platform for breaking news and pretty much every media outlet publishes and promotes stories there, as well as most politicians, govt agencies and so on. Like it or not it is the most 'realtime' mass market platform. That gives Twitter tremendous strategic importance, even though its social graph is smaller and more ephemeral than Facebook's. Size is not everything; reach matters too. That strategic importance makes it interesting to state and non-state actors, because capture of that territory is loosely equivalent to control of radio broadcasting capacity or printing presses in earlier eras. If you think of Twitter as a magically effective print and distribution store for pamphleteers with a huge secondary ecosystem around it, the shutdown of free API access is essentially a market takeover. Musk was spitballing yesterday and suggesting that from now on API access would cost $100/month and require ID to use. (It's interesting to me that Google could have owned that space with their News product, although it has always been a one-way thing rather than socially driven. Their failure to own that space is a direct result of their aversion to user configurability and selection.)
- deleted 4y ago[deleted]
- HWR_14 4y agoYou are correct people on the internet would have argued with them. I should have been clearer. His employees at Twitter, the bankers, the minority shareholders of Twitter and the advertisers would have all accepted his claim that "bots have been defeated enough".
- SketchySeaBeast 4y agoI don't know that they would have, but regardless it seems like Elon really cares what the people online say. He's going out of his way to engaging in memes from his "fans".
- hdjjhhvvhga 4y agoYour problem could be solved by providing read-only API for free - you don't need to write access to do academic research (unless you want to influence the discourse).
- b800h 4y agoProviding a read-only API still costs Twitter money though. He's trying to make it profitable. Seems obvious that stuff like this would be cut.
- capableweb 4y agoNot that obvious, if I was in the same position I wouldn't cut API access, if I was thinking about profits. Maybe make it heavier cached ("slower" time before new tweets are available, less infrastructure costs) but wouldn't disable it fully. My thinking would be that if there is less API access, there is less people accessing tweets, one way or another, and less links back to Twitter. If I woke up feeling evil (really money seeking) I might add some clause to the terms and conditions that you need to prominently display "Powered by Twitter" if you use the API and aggressively check all websites using Twitter API, one way or another. But I guess my perspective would be considered more long term while Musks management of Twitter seems to be heavily focused on short term.
- bryanrasmussen 4y ago>My thinking would be that if there is less API access, there is less people accessing tweets, one way or another, the real problem from a business standpoint is less people trying stuff out and figuring hey maybe I could actually build a business on this, time to move up to the paid tier. Also no devs at companies have played with twitter api because devs not going to spend money to play, so never say in meeting actually we can solve this with Twitter's api, we just have pay for a licence and I can write the solution! So maybe business look for other ways to solve problems.
- jghn 4y ago> Maybe make it heavier cached ("slower" time before new tweets are available, less infrastructure costs) but wouldn't disable it fully. This. I had a brief flirtation with working with people using the Twitter API for research purposes. A very large majority of them didn't care about having the latest tweets coming off the firehose, but instead getting access to all the old data. At least at the time, the latter was much more difficult to do. Things like using Twitter for real time sentiment analysis does require realtime data, but those applications are more likely to be for-profit, and thus could afford to pay.
- jmeister 4y ago"Free API is being abused badly right now by bot scammers & opinion manipulators. There’s no verification process or cost, so easy to spin up 100k bots to do bad things." https://twitter.com/elonmusk/status/1621259936524300289 https://twitter.com/elonmusk/status/1621259936524300289
- binarymax 4y agoThis is mostly untrue. While it’s possible to stay anonymous you need a phone number, and it can’t be from twilio or other services. It’s been this way for years. I strongly suspect the bots that are unverified use headless browsers. The problem won’t go away.
- narag 4y agoTwitter hasn't my phone number, just checked. Maybe is it because my account is old?
- detaro 4y agoYes. But even with an old account, if you sign that up freshly to the developer program they'll force you to provide a phone number, and can require you to go through the approval process for higher API access even if you don't want that.
- Hamuko 4y agoMy Twitter account also has no phone number, but it gives me an error about it if I try to sign up for API access.
- numpad0 4y agoAgreed, while there are tons of spambots, they are likely scraping Web API and using some backdoor-ish thing to get around requirements than using the documented API. This announcement and today's ban-wave that followed seemed like someone not accustomed to Twitter just knew there are bots, and thought it to be workable idea to sample global timeline and script ban duplicates, which of course is not workable at all and only maximize harm on real users.
- snake_doc 4y agoAPI reads/writes don’t generate ad impressions. It’s really that simple. All the bot nonsense is rhetoric.
- madeofpalk 4y agoI think they do. One person writes to the API to post content two other people will see + view ads against.
- rvnx 4y agoThough a lot of the API usage is for content scraping, analytics and surveillance ("we are monitoring the internet for you")
- majewsky 4y agoYou're sounding very confident, so I'm guessing you have a source for that claim? Besides, even if 90% of the API usage is for scraping and does not impact the bottomline, it's still a smart business decision to leave the API open if the remaining 10% are for posting content that brings in views and thus ad impressions that generate more money than the API costs to run.
- rvnx 4y agoIt's the main usage described in the "Twitter Files" (internal docs of Twitter which were openly leaked on Twitter).
- numpad0 4y agoThat shouldn't be possible, API request limits for 3rd party keys were greatly reduced in 2018 to less than what is available for 1st party clients. Extracted 1st party keys or Web scraping would be used for that purpose.
- voytec 4y agoAPI calls just grabbing data may not generate impressions but people follow bots that utilize this API and (some) bot-generated content generates interactions: likes, shares, comments. Twitter may be heading closer towards becoming a ghost town.
- mirekrusin 4y agoPay.
- alexvoda 4y agoCare to link some resources for amateur network science? Search keywords? What tools do you use to monitor the spread of news?
- anigbrowl 4y agohttps://news.ycombinator.com/item?id=34321135 https://news.ycombinator.com/item?id=34321135 Lots of stuff in this thread from myself and multiple other people.
- robga 4y ago> basically a week to decide what to do with your dev project Even less for some. It seems further apps are being shut down in the run up because they have "violated Twitter Rules and policies”. Such as movetodon [0] - locked out today - a service which helps you connect to the fediverse accounts of twitter users you follow. And reports that debirdify is closed out too. [0] https://mastodon.social/@Tibor/109800904950500383 https://mastodon.social/@Tibor/109800904950500383
- rsynnott 4y agoOof. I did a last pass migration last night, and noticed that movetodon was broken then, but I assumed it was due to load, rather than... this. End of an era; Twitter is dead. Whatever is left, it's not Twitter.
- 908B64B197 4y ago> End of an era; Twitter is dead. Whatever is left, it's not Twitter. Am-I the only one surprised the site still hasn't had a major (multi-hour) outage at this point? Considering the waves of resignations that hit the automated content filtering and bot mitigation teams, it's no wonder they are getting desperate.
- mrguyorama 4y agoTwitter still has like 1000 heavily dedicated (either because they love elon or getting fired means getting deported) which means they can fight a lot of fires and keep things going.
- andrekandre 4y ago> getting fired means getting deported i wonder what percent of workers left are in that position?
- rsynnott 4y agoWait, didn’t it? I recall a prolonged period when no-one could log in (and a few prolonged periods where no-one using 2fa could log in)
- westpfelia 4y ago>This seems like more management by manchild. Whaaaaaa but Elon is the god king who will deliver us from evil tech giants!! Are you saying he might be a greater conman then PT Barnum?
- nailer 4y ago> This seems like more management by manchild. You have good points and can probably make them without resorting to insults.
- deleted 4y ago[deleted]
- anigbrowl 4y agoI can, but made a choice to be opinionated here. The CEO of Twitter leverages clownishness for effect, titling himself (at present) as 'Mr Tweet' and uninhibitedly trolling others, often in crude or aggressive terms. While I could take a Ghandian approach of not reciprocating such negative behavior and instead maintain a diplomatic/academic air of prim neutrality, I think Musk's behavior is strategic in that he asserts social permission to 'act out' as the natural consequence of his wealth and power, whereas his critics are obliged to water down their opinions or suffer reputational attack. While I certainly don't want to import the combative and shallow standards of Twitter 'debate' to HN, I do think we have a right tp be opinionated, and that my the term 'manchild' labels a specific sort of behavior rather than some petty or crude dig at his appearance or personal life.
- 2devnull 4y agoI think the person you’re responding to was trying to help you be more persuasive. You can ignore his advice, but it may mean that a lot of people just ignore you or think you’ve got nothing to say.
- mturmon 4y agoYeah, I think use of that term is warranted by the facts. No need to sugar-coat it. Indeed, I'd wish that the HN community was more hostile to Musk's bulldozer approach, seeing what it did to both the company, and the engineers. The whole affair has been needlessly destructive -- obnoxiously so -- and his getting away with it harms the profession.
- numpad0 4y agoIMHO, the name isn’t necessary. Getting names called and deeds attributed is part of the plan, so take steps to not follow the plan if you aren’t trying to be supportive.
- jstummbillig 4y ago> This seems like more management by manchild. "Manchilds" track record in this Game of Life is by and large a testament to how well he understands its rules. And, maybe, how silly they are.
- idiotsecant 4y agoTo be fair, having a lot of money is an excellent way to have more money. Having a lot of money and making some lucky gambles in early technology plays is an even better way to have a lot of money. The fact that every company he owns a significant stake in has a 'manage Elon so that everyone else can get things done' team except for twitter and all of them are not doing insane things, except for twitter, seems to be a pretty strong indication that other enterprises he's involved in are not succeeding because of him, but in spite of him.
- deleted 4y ago[deleted]
- andreygrehov 4y ago> - announced at 10pm - basically a week to decide what to do with your dev project I believe it's an intentional and strategic move to have every API client to start paying right away.
- throwaway743 4y agoTime to use selenium
- bmitc 4y ago> This seems like more management by manchild. I strongly suspect that Musk realized his promises of cutting down bots etc. were failing He probably started to realize that other people began to realize just how many Tesla bots there are.
- krageon 4y agoIt's simple: Use the website. It will never stop working because people use it and you can automate and scrape it just fine. Kind of sucks that you have to go through the effort - but then there is no social media corporation that isn't toxic in some way to it's userbase.
- 1vuio0pswjnm7 4y agoDoes not take much effort. Below is an example using curl. For reading Twitter feeds I just get the JSON and read the "full_text" objects. I have simple custom program I wrote that turns JSON of unlimited size into something like line-delimited JSON so I can use sed, grep and awk on it but HN readers probably prefer jq. For checking out t.co URLs I use HTTP/1.1 pipelining. Usage for reading is something like (but not identical to) 1.sh screen_name > 1.json yy059 < 1.json|grep full_text > 1.txt less 1.txt Usage for checking out URLs is something like (but not identical to) unset connection export Connection=keep-alive yy059 < 1.json|grep full_text \ |yy030 \ |grep "https://t.co/.{10}$" \ |uniq \ |yy025 \ |nc -vv h1b 80 \ |sed -n '/location: /s///p' \ |ahref > 1.htm links -no-connect 1.htm "ahref" is just a script turns URLs on stdin into simple HTML on stdout Alternatively if I do not trust the URLs I might use a script called "www" instead of ahref. It takes URLs on stdin and fetches archive.org URLs wrapped in simple HTML to stdout, using the IA's cdx API. #!/bin/sh SCREEN_NAME=$1 COUNT=500 PUBLIC_TOKEN="Bearer AAAAAAAAAAAAAAAAAAAAANRILgAAAAAAnNwIzUejRCOuH5E6I8xnZz4puTs%3D1Zv7ttfk8LF81IUq16cHjhLTvJu4FA33AGWWjCpTnA" GT=$(exec curl -A "" -s https://twitter.com/$SCREEN_NAME|sed -n '/gt=/{s/.*gt=//;s/;.*//p;}'); echo "x-guest-token: $GT" >&2; REST_ID=$(exec curl -A "" -H "authorization: $PUBLIC_TOKEN" -H "content-type: application/json" -H "x-guest-token: $GT" -s "https://twitter.com/i/api/graphql/mCbpQvZAw6zu_4PvuAUVVQ/UserByScreenName?variables=%7B%22screen_name%22%3A%22$SCREEN_NAME%22%2C%22withSafetyModeUserFields%22%3Atrue%2C%22withSuperFollowsUserFields%22%3Atrue%7D"|sed 's/\(rest_id\":\"[0-9]*\)\(.*\)/\1/;s/.*\"//'); echo "rest_id: $REST_ID" >&2; curl -A "" -H "authorization: $PUBLIC_TOKEN" -H "content-type: application/json" -H "x-guest-token: $GT" -s "https://twitter.com/i/api/graphql/3ywp9kIIW-VQOssauKmLiQ/UserTweets?variables=%7B%22userId%22%3A%22${REST_ID}%22%2C%22count%22%3A$COUNT%2C%22includePromotedContent%22%3Atrue%2C%22withQuickPromoteEligibilityTweetFields%22%3Atrue%2C%22withSuperFollowsUserFields%22%3Atrue%2C%22withDownvotePerspective%22%3Afalse%2C%22withReactionsMetadata%22%3Afalse%2C%22withReactionsPerspective%22%3Afalse%2C%22withSuperFollowsTweetFields%22%3Atrue%2C%22withVoice%22%3Atrue%2C%22withV2Timeline%22%3Atrue%7D&features=%7B%22dont_mention_me_view_api_enabled%22%3Atrue%2C%22interactive_text_enabled%22%3Atrue%2C%22responsive_web_uc_gql_enabled%22%3Afalse%2C%22vibe_tweet_context_enabled%22%3Afalse%2C%22responsive_web_edit_tweet_api_enabled%22%3Afalse%2C%22standardized_nudges_misinfo%22%3Afalse%2C%22responsive_web_enhance_cards_enabled%22%3Afalse%2C%22include_rts%22%3Atrue%7D" There's no way I would use the Twitter website as it requires enabling Javascript and not for the user's benefit. This solution isn't pretty but I can easily keep tabs on Twitter feeds without any need for a Twitter account, a Twitter "API key" or a so-called "modern" browser.
- asdadsdad 4y agoI don't think that's too related to cutting down bots. It's about making money from their dataset, which is valid. Why do people think they can hammer an API without paying?
- anigbrowl 4y agoThey already have an enterprise tier for people who want to build commercial stuff on top of Twitter, and they already monetize their datasets and have done for years. How do you expect to sign up students/new developers if they have to pay before they figure out how to use the API?
- asdadsdad 4y agoWell they mentioned "basic tier API", so I guess let's wait for the pricing and capabilities, no? My main criticism is they're not being assholes just for charging for an API access to their data.
- BulgarianIdiot 4y agoYou can't "wait for pricing and capabilities" as they're cutting access literally one week from now. No attempt at making this seem like reasonable behavior and communication with developers can succeed here. And by the way if you expect reasonable cost, you're in for a surprise. Twitter is DESPERATE for cash.
- noirscape 4y agoIn my case I literally just had a bot running to pull in my own following/followers list so I could diff them and then tweet out the result privately so I'd be aware of any changes to it. It was useful to check to see if someone else decided to softblock me/deactivated their account (and in at least one case, has helped me to reach out to someone in need). That's not "making money from the dataset", it was a hobby project and I imagine the overwhelming majority of Twitter bots are that. (Most of the ones I used to follow generally just scraped various subreddits to tweet out/source fun art to look at). I'm not gonna pay money to access my own data, Musk can sink in his own shit for that and I don't blame any of those other hobby bot devs for not wanting to do that either.
- Felkomo 4y agoBut there is no need for Twitter to allow you to do that for free just because. From a pure business perspective it's either Twitter dies or Elon pays the bills.
- mjmsmith 4y agoWhy not both?
- wil421 4y agoI’m sure it didn’t help that Elon pissed off most of Twitter’s advertisers. They jumped shipped as soon as he took over. > Daily Revenue Has Dropped 40%, 500 Top Advertisers Have Left https://www.theinformation.com/articles/twitter-manager-daily-revenue-has-dropped-40-500-top-advertisers-have-left https://www.theinformation.com/articles/twitter-manager-dail...
- Ciantic 4y agoTwitter wouldn't die if they don't pay bills, someone would buy it for huge discount. It seems like it would be the best way forward, depending on who would buy it. A lot of people don't follow news or Elon drama, the brand still has a lot of value. Especially abroad where news about Elon are much fewer.
- ndsipa_pomu 4y agoIt'd have to be a huge discount as they'd be buying the debt along with it. Why would someone want to saddle themselves with an unprofitable debt burden?
- hgsgm 4y agoBofA/whoever lent $12B or whatever to Twitter/Elon. Ultimately they have to settle for lower payments or get Tesla stock or whatever, and the debt is cleared. Or it defaults. Either way, Twitter the service has no reason to shut down, and doesn't carry that debt further. Once the debt cost is sunk, what matters is future marginal profitability.