5 ms·

Indian Railways stations, trains and schedules database in JSON and SQL formats

178 points by sramana9 15y ago

ing33k 15y ago
good job. But I am still not sure if its legally Ok to use this data.. btw Dropbox has temporarily disabled the download links..
alagu 15y ago
Shameless plug: I built a Chrome extension that helps you track all your Indian Railway tickets in one go - https://chrome.google.com/webstore/detail/almdggoleggeecgelbjekpmefpohdjck https://chrome.google.com/webstore/detail/almdggoleggeecgelb...
joelhaasnoot 15y ago
This is awesome. Doing this for the Netherlands, and there is a public API (but no schedule API, just a trip planner). Plans for GTFS? As awful as it seems, it is a nice format and has lots of tools. In half an hour with OpenTripPlanner and OpenStreetMaps and GTFS data (and a computer with 16GB RAM) you can have a trip planner ready to go.
rehack 15y ago
This is highly commendable effort. I have been the lead programmer of an India based travel search engine, so understand the value of this data. Another problem to be solved is: Building a cache of seat availability. Basically, the Indian Railways guys can not provide the availability fast enough. And it affects every body - from end consumers using their websites, to OTA sites, to travel-search players. I can't understand, why no body in the Railways IT dept. (i.e. CRIS) thought of having a PUSH based cache. The way it can work is each reservation/booking done causes a PUSH onto the state of the seat availability cache. Which is a very fast cache (probably based on memcached). If they allow me, I can code the cache for FREE, for them. Provided they also stop being so possessive about their data. And allow for apps like yours and mine to flourish, which ultimately benefit the traveler. EDIT: minor rephrase
rasagy 15y ago
After noticing a comment on the site, I checked the "Disclaimer" pages on the 2 official sites (Both don't allow storing this data in any form). However, the 3rd source http://indiarailinfo.com/ http://indiarailinfo.com/ is not affiliated to the gov. Are there any NGO/organizations that could push for such data to be made public in India? I'll try getting in touch with CIS (http://www.cis-india.org/ http://www.cis-india.org/). Disclaimers on: http://www.indianrail.gov.in/disclaimer.html http://www.indianrail.gov.in/disclaimer.html & http://trainenquiry.com/StaticContent/disclaim.aspx http://trainenquiry.com/StaticContent/disclaim.aspx
- asto 15y ago
  It's probably to prevent link scrapers from putting further load on the already poorly performing site! If they allow people to freely use the data, there's a good chance that a lot of sites mushroom to provide railways data
  - rasagy 15y ago
    That holds true for all open data, right? I still find others (like NY MTA: http://mta.info/developers/ http://mta.info/developers/) providing open data (in GTFS). Agreed about the load part though.
- sramana9 15y ago
  Thanks for informing me that it is not legal to scrape http://www.indianrail.gov.in http://www.indianrail.gov.in. I am rewriting the code to scrape only http://indiarailinfo.com http://indiarailinfo.com, which does not explicitly forbid scraping. Is it legal to scrape such a site (without overloading it)? Is it legal to share that code?
  - rasagy 15y ago
    I'm not sure if there are any general rules/guidelines in India for this. However, IndianRailInfo doesn't have any Copyright/Disclaimer mentioned on their homepage. So I see no reason why it should be a problem. Re:Source, till it's not used to scrape Copyright/private data, it shouldn't be a problem. Mention this clause in the disclaimer/license. Will you be putting it on GitHub?
muxxa 15y ago
Brilliant. I'm excited about attempting to use the data to produce an Indian timetable site on top of the frontend I've built for Irish rail and bus; http://getthere.ie/ http://getthere.ie/
kia 15y ago
Suggestion: add archives in more Unix friendly format (xz, gz, bz2). Not everyone has zip installed on their Unix box.
- dkd903 15y ago
  installing unzip is not that hard i guess. CHeers to Sramana for getting this out :-)
- Sanddancer 15y ago
  Gzip and zip use the same compression format, and it's just a single file, so you can use gunzip -S to uncompress this just fine.
mpunaskar 15y ago
Excellent & highly useful database. Its always helpful to get such type of data in public domain. This way independent developers can build useful apps for community. +1 for efforts.
mpunaskar 15y ago
On side Note : If someone decides to build train timetable site - it would be highly useful to add Local taxi hire company numbers (near destination station). It will be highly useful as people would love to pre-book taxis as well.
- vinutheraj 15y ago
  Is there a way to get such data ? Other than going out an actively contacting the taxi companies ?
  - mpunaskar 15y ago
    I'm not sure about taxi companies data. may be you can scrape it off yellow pages like sites.
blntechie 15y ago
Appreciate the effort. I asked this other day on HN on a related thread. But is crawling the official sites legal? And also how frequent it's going to be updated? Just want to make sure before using this in an idea I have for a Windows phone app.
- alagu 15y ago
  This is definitely not legal - http://www.indianrail.gov.in/disclaimer.html http://www.indianrail.gov.in/disclaimer.html. There was a discussion sometime back in HSI about this - http://hackerstreet.in/item?id=6252 http://hackerstreet.in/item?id=6252
vinutheraj 15y ago
Error (509) This account's public links are generating too much traffic and have been temporarily disabled!
- dlsspy 15y ago
  Yeah, I'm really eager to find a mirror. I like playing with data like this and I'm flying to India tomorrow.
davidwhodge 15y ago
I've contacted the site owner and I'll see if I can get a mirror set up for those files.
anmol 15y ago
Due time, thanks for doing this. Everytime I'm booking an Indian rail ticket I cringe at the UI/UX on the official Indian Railways site.
Craiggybear 15y ago
Error (509) This account's public links are generating too much traffic and have been temporarily disabled! :(
dhaivatpandya 15y ago
Maybe someone can write a wrapper around the indian train schedule website then, because it sucks.
sramana9 15y ago
Thanks everyone for the comments. I updated the links and now downloads are working. Sorry for the delay.
QuarkSpark 15y ago
This is a really awesome accomplishment. Keep going!
threepointone 15y ago
I will gladly sponsor hosting these files, if someone can send a copy my way.
denzil_correa 15y ago
Good going! :-)

178 points by sramana9 15y ago

good job. But I am still not sure if its legally Ok to use this data.. btw Dropbox has temporarily disabled the download links..

alagu 15y ago

Shameless plug: I built a Chrome extension that helps you track all your Indian Railway tickets in one go - https://chrome.google.com/webstore/detail/almdggoleggeecgelbjekpmefpohdjck https://chrome.google.com/webstore/detail/almdggoleggeecgelb...

joelhaasnoot 15y ago

This is awesome. Doing this for the Netherlands, and there is a public API (but no schedule API, just a trip planner). Plans for GTFS? As awful as it seems, it is a nice format and has lots of tools. In half an hour with OpenTripPlanner and OpenStreetMaps and GTFS data (and a computer with 16GB RAM) you can have a trip planner ready to go.

rehack 15y ago

This is highly commendable effort. I have been the lead programmer of an India based travel search engine, so understand the value of this data. Another problem to be solved is: Building a cache of seat availability. Basically, the Indian Railways guys can not provide the availability fast enough. And it affects every body - from end consumers using their websites, to OTA sites, to travel-search players. I can't understand, why no body in the Railways IT dept. (i.e. CRIS) thought of having a PUSH based cache. The way it can work is each reservation/booking done causes a PUSH onto the state of the seat availability cache. Which is a very fast cache (probably based on memcached). If they allow me, I can code the cache for FREE, for them. Provided they also stop being so possessive about their data. And allow for apps like yours and mine to flourish, which ultimately benefit the traveler. EDIT: minor rephrase

rasagy 15y ago

After noticing a comment on the site, I checked the "Disclaimer" pages on the 2 official sites (Both don't allow storing this data in any form). However, the 3rd source http://indiarailinfo.com/ http://indiarailinfo.com/ is not affiliated to the gov. Are there any NGO/organizations that could push for such data to be made public in India? I'll try getting in touch with CIS (http://www.cis-india.org/ http://www.cis-india.org/). Disclaimers on: http://www.indianrail.gov.in/disclaimer.html http://www.indianrail.gov.in/disclaimer.html & http://trainenquiry.com/StaticContent/disclaim.aspx http://trainenquiry.com/StaticContent/disclaim.aspx

asto 15y ago
It's probably to prevent link scrapers from putting further load on the already poorly performing site! If they allow people to freely use the data, there's a good chance that a lot of sites mushroom to provide railways data
- rasagy 15y ago
  That holds true for all open data, right? I still find others (like NY MTA: http://mta.info/developers/ http://mta.info/developers/) providing open data (in GTFS). Agreed about the load part though.
sramana9 15y ago
Thanks for informing me that it is not legal to scrape http://www.indianrail.gov.in http://www.indianrail.gov.in. I am rewriting the code to scrape only http://indiarailinfo.com http://indiarailinfo.com, which does not explicitly forbid scraping. Is it legal to scrape such a site (without overloading it)? Is it legal to share that code?
- rasagy 15y ago
  I'm not sure if there are any general rules/guidelines in India for this. However, IndianRailInfo doesn't have any Copyright/Disclaimer mentioned on their homepage. So I see no reason why it should be a problem. Re:Source, till it's not used to scrape Copyright/private data, it shouldn't be a problem. Mention this clause in the disclaimer/license. Will you be putting it on GitHub?

muxxa 15y ago

Brilliant. I'm excited about attempting to use the data to produce an Indian timetable site on top of the frontend I've built for Irish rail and bus; http://getthere.ie/ http://getthere.ie/

kia 15y ago

Suggestion: add archives in more Unix friendly format (xz, gz, bz2). Not everyone has zip installed on their Unix box.

dkd903 15y ago
installing unzip is not that hard i guess. CHeers to Sramana for getting this out :-)
Sanddancer 15y ago
Gzip and zip use the same compression format, and it's just a single file, so you can use gunzip -S to uncompress this just fine.

mpunaskar 15y ago

Excellent & highly useful database. Its always helpful to get such type of data in public domain. This way independent developers can build useful apps for community. +1 for efforts.

mpunaskar 15y ago

On side Note : If someone decides to build train timetable site - it would be highly useful to add Local taxi hire company numbers (near destination station). It will be highly useful as people would love to pre-book taxis as well.

vinutheraj 15y ago
Is there a way to get such data ? Other than going out an actively contacting the taxi companies ?
- mpunaskar 15y ago
  I'm not sure about taxi companies data. may be you can scrape it off yellow pages like sites.

blntechie 15y ago

Appreciate the effort. I asked this other day on HN on a related thread. But is crawling the official sites legal? And also how frequent it's going to be updated? Just want to make sure before using this in an idea I have for a Windows phone app.

alagu 15y ago
This is definitely not legal - http://www.indianrail.gov.in/disclaimer.html http://www.indianrail.gov.in/disclaimer.html. There was a discussion sometime back in HSI about this - http://hackerstreet.in/item?id=6252 http://hackerstreet.in/item?id=6252

vinutheraj 15y ago

Error (509) This account's public links are generating too much traffic and have been temporarily disabled!

dlsspy 15y ago
Yeah, I'm really eager to find a mirror. I like playing with data like this and I'm flying to India tomorrow.

davidwhodge 15y ago

I've contacted the site owner and I'll see if I can get a mirror set up for those files.

anmol 15y ago

Due time, thanks for doing this. Everytime I'm booking an Indian rail ticket I cringe at the UI/UX on the official Indian Railways site.

Craiggybear 15y ago

Error (509) This account's public links are generating too much traffic and have been temporarily disabled! :(

dhaivatpandya 15y ago

Maybe someone can write a wrapper around the indian train schedule website then, because it sucks.

sramana9 15y ago

Thanks everyone for the comments. I updated the links and now downloads are working. Sorry for the delay.

QuarkSpark 15y ago

This is a really awesome accomplishment. Keep going!

threepointone 15y ago

I will gladly sponsor hosting these files, if someone can send a copy my way.

denzil_correa 15y ago

Good going! :-)