3 ms·

Except don't they have a special deal with Google to use the firehose?

• guiambros 11y ago
  IMO, that's exactly the reason. Before search engines could scrape the data and load the content for free. Now they'll need to reach firehose data agreements.
  • Paulods 11y ago
    Take a look at the robots file without the "www" subdomain. Its likely to prevent content duplication/push for only the non "www" url to appear on search engines. https://twitter.com/robots.txt https://twitter.com/robots.txt
    • guiambros 11y ago
      Uh... Excellent point. Seems the entire speculation is/was unfounded.