5 ms·

How to fetch NYSE prices with simple bash script

29 points by darkduck 15y ago

lrm242 15y ago
Just use Yahoo Finance like the rest of the punters out there. Why on earth would you scrape data this way when Yahoo gives you a simple, clean, dummy proof API. You can get end of day prices, dividend information, volume, all sorts of information.
- veyron 15y ago
  I'm guessing the target audience isnt particularly sophisticated, given that their "in-depth" howto on the linux kernel consists of menuconfig: http://how-to.linuxcareer.com/in-depth-howto-on-linux-kernel-configuration http://how-to.linuxcareer.com/in-depth-howto-on-linux-kernel...
  - eli 15y ago
    Yeah, but the old (unofficial) Yahoo API is just a URL that gives a CSV file you could open in Excel (or OpenOffice, whatever)
- mynameishere 15y ago
  Ameritrade and Interactive Brokers have real APIs (C# and Java/C++ respectively) if anyone is interested.
skeletonjelly 15y ago
Better off using something like Yahoo! Query Language http://www.yqlblog.net/blog/2009/06/02/getting-stock-information-with-yql-and-open-data-tables/ http://www.yqlblog.net/blog/2009/06/02/getting-stock-informa...
apaprocki 15y ago
Sorry to be the one to say it, but... http://eoddata.com/about/terms.aspx http://eoddata.com/about/terms.aspx 6. AUTOMATED DOWNLOADS 5.1 Our data can be downloaded via the website, ftp, web services and through our DataClient software. Automated downloads from our website through scripts or utilities (scraping) is not permitted. Any attempt to access our data via the website in an automated manner using download utilities will be blocked. If you would like to automate your downloads then you must use either the FTP site or our XML web service.
- beaumartinez 15y ago
  > "Any attempt to access our data via the website in an automated manner using download utilities will be blocked." Yeah, good luck with that.
  - eli 15y ago
    it might also be a crime in the US (though it shouldn't be)
  - getsat 15y ago
    I just tried to buy the historical 20 year NYSE data, but I can't complete the checkout process. The Confirm page just refreshes itself when you submit the form. :|
michaelcampbell 15y ago
Does a wrapper around wget qualify as a "simple bash script"?
- pavel_lishin 15y ago
  Can't get much simpler than that, right?
  - michaelcampbell 15y ago
    I guess, but the implication is that it's bash doing the work, when it is clearly not.
deleted 15y ago
[deleted]

29 points by darkduck 15y ago

Just use Yahoo Finance like the rest of the punters out there. Why on earth would you scrape data this way when Yahoo gives you a simple, clean, dummy proof API. You can get end of day prices, dividend information, volume, all sorts of information.

veyron 15y ago
I'm guessing the target audience isnt particularly sophisticated, given that their "in-depth" howto on the linux kernel consists of menuconfig: http://how-to.linuxcareer.com/in-depth-howto-on-linux-kernel-configuration http://how-to.linuxcareer.com/in-depth-howto-on-linux-kernel...
- eli 15y ago
  Yeah, but the old (unofficial) Yahoo API is just a URL that gives a CSV file you could open in Excel (or OpenOffice, whatever)
mynameishere 15y ago
Ameritrade and Interactive Brokers have real APIs (C# and Java/C++ respectively) if anyone is interested.

skeletonjelly 15y ago

Better off using something like Yahoo! Query Language http://www.yqlblog.net/blog/2009/06/02/getting-stock-information-with-yql-and-open-data-tables/ http://www.yqlblog.net/blog/2009/06/02/getting-stock-informa...

apaprocki 15y ago

Sorry to be the one to say it, but... http://eoddata.com/about/terms.aspx http://eoddata.com/about/terms.aspx 6. AUTOMATED DOWNLOADS 5.1 Our data can be downloaded via the website, ftp, web services and through our DataClient software. Automated downloads from our website through scripts or utilities (scraping) is not permitted. Any attempt to access our data via the website in an automated manner using download utilities will be blocked. If you would like to automate your downloads then you must use either the FTP site or our XML web service.

beaumartinez 15y ago
> "Any attempt to access our data via the website in an automated manner using download utilities will be blocked." Yeah, good luck with that.
- eli 15y ago
  it might also be a crime in the US (though it shouldn't be)
- getsat 15y ago
  I just tried to buy the historical 20 year NYSE data, but I can't complete the checkout process. The Confirm page just refreshes itself when you submit the form. :|

michaelcampbell 15y ago

Does a wrapper around wget qualify as a "simple bash script"?

pavel_lishin 15y ago
Can't get much simpler than that, right?
- michaelcampbell 15y ago
  I guess, but the implication is that it's bash doing the work, when it is clearly not.

deleted 15y ago

[deleted]