3 ms·

> You can't do pattern matching or whatever without access to the data... If you want "access to the data", you can get a firehose subscription from gnip.com o

by dxbydt 14y ago

> You can't do pattern matching or whatever without access to the data... If you want "access to the data", you can get a firehose subscription from gnip.com or datasift.com I once built an elaborate options pricer, only to find that my "access to the data" - which was basically a scraper from finance.google.com, was cut off. So I switched to finance.yahoo.com and soon enough they cut me off too! So I asked my professor and did what he told me - pay the subscription to IV ( http://www.ivolatility.com/data/historical_data.html http://www.ivolatility.com/data/historical_data.html ) and voila, the socket was instantly open and I could suck in as much data as I wanted.

ricardobeat 14y ago
So, basically, pay or shut up? Access to 50% of Twitter messages is gonna cost you only $360,000 per year. That will certainly foster innovation. http://www.readwriteweb.com/archives/twitter_to_sell_50_of_all_tweets_for_360kyear_thro.php http://www.readwriteweb.com/archives/twitter_to_sell_50_of_a...
LiveTheDream 14y ago
Do you mind saying roughly how much the IV subscription costs? All I could find was "email for quote".
- dxbydt 14y ago
  It was 10 dollars for a month's access to a few MB of cleaned up csv historical option prices of a specific ticker. And that's how resellers work - you pay exactly for what you want. Nobody's saying you have to pay 360000, like the other post implies.
  - ricardobeat 14y ago
    Except that for Twitter you do. A few MB = 30 seconds of tweets. I don't know why you think financial feeds are related to twitter, other than both being data feeds. The $360k price tag is not "implied", it's the actual price for access to 50% of twitter's messages (see the link I posted). 100% access can only be negotiated with Twitter itself. To be fair, from the information I could find, the cheapest plan from gnip is $500/month[1], datasift is $3000/month[2], both quickly go up. That means you can't just whip up a prototype in the weekend for some new idea anymore. This pricing probably filters out 99% of the things that could be built on it, limiting them to projects with investor backing and ready business models (which twitter itself still doesn't have). [1] http://web.appstorm.net/how-to/social-media-how-to/gnip-the-social-media-goldmine/ http://web.appstorm.net/how-to/social-media-how-to/gnip-the-... [2] http://datasift.com/pricing#costs http://datasift.com/pricing#costs

by dxbydt 14y ago

ricardobeat 14y ago

So, basically, pay or shut up? Access to 50% of Twitter messages is gonna cost you only $360,000 per year. That will certainly foster innovation. http://www.readwriteweb.com/archives/twitter_to_sell_50_of_all_tweets_for_360kyear_thro.php http://www.readwriteweb.com/archives/twitter_to_sell_50_of_a...

LiveTheDream 14y ago

Do you mind saying roughly how much the IV subscription costs? All I could find was "email for quote".

dxbydt 14y ago
It was 10 dollars for a month's access to a few MB of cleaned up csv historical option prices of a specific ticker. And that's how resellers work - you pay exactly for what you want. Nobody's saying you have to pay 360000, like the other post implies.
- ricardobeat 14y ago
  Except that for Twitter you do. A few MB = 30 seconds of tweets. I don't know why you think financial feeds are related to twitter, other than both being data feeds. The $360k price tag is not "implied", it's the actual price for access to 50% of twitter's messages (see the link I posted). 100% access can only be negotiated with Twitter itself. To be fair, from the information I could find, the cheapest plan from gnip is $500/month[1], datasift is $3000/month[2], both quickly go up. That means you can't just whip up a prototype in the weekend for some new idea anymore. This pricing probably filters out 99% of the things that could be built on it, limiting them to projects with investor backing and ready business models (which twitter itself still doesn't have). [1] http://web.appstorm.net/how-to/social-media-how-to/gnip-the-social-media-goldmine/ http://web.appstorm.net/how-to/social-media-how-to/gnip-the-... [2] http://datasift.com/pricing#costs http://datasift.com/pricing#costs