6 ms·

Analyzing Caltrain Delays

64 points by jsweojtj 11y ago

guard-of-terra 11y ago
Seriously, need to break that vicious cycle: you get used to things going bad, people who run them get used to not delivering, breaking due process, posting unrealistic schedules, and BAM - now you think the problem can't be solved, only plotted. I don't remember last time when I have not seen a train at a station at scheduled time, and the place where I live doesn't expire confidence. When something is late, it gets in the news. Not every week.
- ZanyProgrammer 11y ago
  To be (grudgingly) fair to Caltrain, a lot of things are perhaps indirectly out of their control-stuff like suicides (until you get gated platforms to stop people from jumping in front of Baby Bullets) and vehicles stopped on tracks are hard to predict. Likewise they are a victim of their own success-standing room only trains make boarding and unboarding longer than they have to be. Of course, Caltrain has put off electrification and grade separation for a long time, and even now its massively expensive and ruinous (see the CBOSS fiasco) so its not like they are totally off the hook.
  - archagon 11y ago
    I can't help but feel that if there was a BART line where the Caltrain currently runs, things would be about a hundred times better than they currently are, on all fronts. Alas...
    - ZanyProgrammer 11y ago
      Electrified Caltrain is infinitely preferable to BART.
      - archagon 11y ago
        Only if you get rid of the behemoth slowpoke trains, elevate the rails, add more rail lines, and add a corridor to the East Bay. The Millbrae Caltrain/BART connection is a joke.
      - nulltype 11y ago
        Why electrified vs normal caltrain? Will that decrease the variance or door to door time of using caltrain?
        ac29 11y ago
        There is a lot of info here [1], summarized here [2]. Probably of the most interest to most people is "Improved Train Performance, Increased Ridership Capacity and Increased Service: Electrified trains can accelerate and decelerate more quickly than diesel-powered trains, allowing Caltrain to run more efficiently. In addition, because of their performance advantages, electrified trains will enable more frequent and/or faster train service to more riders". [1]http://www.caltrain.com/projectsplans/CaltrainModernization/Modernization/PeninsulaCorridorElectrificationProject.html http://www.caltrain.com/projectsplans/CaltrainModernization/... [2] http://www.caltrain.com/Assets/Caltrain+Modernization+Program/Documents/PCEP+Fact+Sheet+May+2015.pdf http://www.caltrain.com/Assets/Caltrain+Modernization+Progra...
        avuserow 11y ago
        Faster acceleration. Each stop will cost less time, and Caltrain has a surprising amount of stops between SF-SJ (22 weekday) for its length (47 miles). You can see this effect already with the amount of express schedules that Caltrain has and their varying trip times.
        nulltype 11y ago
        Yeah I couldn't find any estimates about how much time though. It seems like the express train would not be affected much at all.
      - dasil003 11y ago
    - ZanyProgrammer 11y ago
      BART should've taken over SP's Peninsula Commute in the 70s, when SP really wanted to get rid of it. Even better would be if BART ran standard gauge and overhead wire.
      - jrnichols 11y ago
        BART tried to, but IIRC San Mateo county unwisely pulled out of the project back in the early days. Part of the reason that it took ages to get BART to Millbrae. That Daly City - Colma - SFO extension took way longer than it should have.
    - avuserow 11y ago
      What I perceive as the good bits of BART could be replicated on Caltrain with much less effort than replacing Caltrain with BART: the off-peak timetable. Caltrain does better for longer trips in my (limited to South Bay) experience, which makes sense since Caltrain average trip length is 1.5x to 2x longer than BART's. But overall, getting improvements seems much less technical and more political, and neither system seems to have much luck.
  - twblalock 11y ago
    The major cause of the problem is the balkanization of transit planning in the Bay Area. Most metropolitan areas this size have some kind of transit authority that plans systematically for the entire region. We are stuck with multiple incompatible systems, and small NIMBY cities like Menlo Park get to block development that would benefit everyone.
  - avuserow 11y ago
    Vehicle and person hits cause exceptional delays, but not significantly more so than the string of breakdowns in February. They apologized for this, and seem to have fewer rush hour problems, so maybe this has improved. They could do more to improve the standing room problem, which adds up quickly. My evening train is now perpetually 3-5 minutes late, which adds 10% to the runtime, due to the train in front being overcrowded. They are putting out new timetables for next month that they claim will improve this. Their fix is to move its departure time closer to the slow train in front, and add 3 minutes to the trip duration. Frustrating.
ZanyProgrammer 11y ago
If only Caltrain had a decent API for developers that produced data that is needed for any serious analysis (like train number, speed and lat/long). I hate having to resort to hackey workarounds like scraping for this info. I believe the NextBus API for MUNI has actual positional data and vehicle info. Caltrain, being the mediocre agency it is, has a next to useless API (if I remember the docs correctly on 511.org).
- jsweojtj 11y ago
  An API would go a long way and realtime information would obviously be awesome. It appears that even if Caltrain provided historical data of actual departure times per train per station, that would be a huge improvement.
mattcaywood 11y ago
Data scientists blog about Caltrain data, come up with convoluted hypothesis about bias in sensors at two stations. Commenter on blog notices that Caltrain is occasionally single-tracking between those stations due to a bridge replacement. [1] "Data science" ends up with a bloody neck from Occam's razor. [1] http://www.caltrain.com/projectsplans/Projects/Caltrain_Capital_Program/San_Mateo_Bridges_Replacement_Project.html http://www.caltrain.com/projectsplans/Projects/Caltrain_Capi...
- xivzgrev 11y ago
  The data was sound. They formed a hypothesis. They got a better explanation. Now they have a better hypothesis for the data anamoly. I don't think it's fair to fault them or to discredit the effort.
  - mattcaywood 11y ago
    I'm criticizing the approach of starting the analysis in a vacuum and coming up with a hypothesis that fits the abstract pattern, when simple domain knowledge (from looking at a website, or a Caltrain station notice board) would have put them on the "right track" from the start. What the authors did falls into the trap of a very stereotypical criticism of data science and doesn't do data science any favors.
- lifestil 11y ago
  '"Data science" ends up with a bloody neck from Occam's razor.' Heh, I like the imagery. I wouldn't really call it Data Science with capital letters either. It's just plain-old exploratory analysis. I wouldn't say the hypothesis is convoluted, especially since we see bizarre data coming out of Caltrain API at times, and experience has taught us to distrust our instruments when observing strong systematic bias. But single-tracking due to construction IS obviously a better explanation... because it's probably true. What is still confusing is that the train is delayed several minutes, but then recovers at the very next station. That is odd behavior for a train to 'make up' that much time so quickly. Typical behavior is just to keep getting later. Or maybe Occam will strike again in the comments with an obviously correct explanation!

64 points by jsweojtj 11y ago

Seriously, need to break that vicious cycle: you get used to things going bad, people who run them get used to not delivering, breaking due process, posting unrealistic schedules, and BAM - now you think the problem can't be solved, only plotted. I don't remember last time when I have not seen a train at a station at scheduled time, and the place where I live doesn't expire confidence. When something is late, it gets in the news. Not every week.

ZanyProgrammer 11y ago
To be (grudgingly) fair to Caltrain, a lot of things are perhaps indirectly out of their control-stuff like suicides (until you get gated platforms to stop people from jumping in front of Baby Bullets) and vehicles stopped on tracks are hard to predict. Likewise they are a victim of their own success-standing room only trains make boarding and unboarding longer than they have to be. Of course, Caltrain has put off electrification and grade separation for a long time, and even now its massively expensive and ruinous (see the CBOSS fiasco) so its not like they are totally off the hook.
- archagon 11y ago
  I can't help but feel that if there was a BART line where the Caltrain currently runs, things would be about a hundred times better than they currently are, on all fronts. Alas...
  - ZanyProgrammer 11y ago
    Electrified Caltrain is infinitely preferable to BART.
    - archagon 11y ago
      Only if you get rid of the behemoth slowpoke trains, elevate the rails, add more rail lines, and add a corridor to the East Bay. The Millbrae Caltrain/BART connection is a joke.
    - nulltype 11y ago
      Why electrified vs normal caltrain? Will that decrease the variance or door to door time of using caltrain?
      - ac29 11y ago
        There is a lot of info here [1], summarized here [2]. Probably of the most interest to most people is "Improved Train Performance, Increased Ridership Capacity and Increased Service: Electrified trains can accelerate and decelerate more quickly than diesel-powered trains, allowing Caltrain to run more efficiently. In addition, because of their performance advantages, electrified trains will enable more frequent and/or faster train service to more riders". [1]http://www.caltrain.com/projectsplans/CaltrainModernization/Modernization/PeninsulaCorridorElectrificationProject.html http://www.caltrain.com/projectsplans/CaltrainModernization/... [2] http://www.caltrain.com/Assets/Caltrain+Modernization+Program/Documents/PCEP+Fact+Sheet+May+2015.pdf http://www.caltrain.com/Assets/Caltrain+Modernization+Progra...
      - avuserow 11y ago
        Faster acceleration. Each stop will cost less time, and Caltrain has a surprising amount of stops between SF-SJ (22 weekday) for its length (47 miles). You can see this effect already with the amount of express schedules that Caltrain has and their varying trip times.
        nulltype 11y ago
        Yeah I couldn't find any estimates about how much time though. It seems like the express train would not be affected much at all.
    - dasil003 11y ago
  - ZanyProgrammer 11y ago
    BART should've taken over SP's Peninsula Commute in the 70s, when SP really wanted to get rid of it. Even better would be if BART ran standard gauge and overhead wire.
    - jrnichols 11y ago
      BART tried to, but IIRC San Mateo county unwisely pulled out of the project back in the early days. Part of the reason that it took ages to get BART to Millbrae. That Daly City - Colma - SFO extension took way longer than it should have.
  - avuserow 11y ago
    What I perceive as the good bits of BART could be replicated on Caltrain with much less effort than replacing Caltrain with BART: the off-peak timetable. Caltrain does better for longer trips in my (limited to South Bay) experience, which makes sense since Caltrain average trip length is 1.5x to 2x longer than BART's. But overall, getting improvements seems much less technical and more political, and neither system seems to have much luck.
- twblalock 11y ago
  The major cause of the problem is the balkanization of transit planning in the Bay Area. Most metropolitan areas this size have some kind of transit authority that plans systematically for the entire region. We are stuck with multiple incompatible systems, and small NIMBY cities like Menlo Park get to block development that would benefit everyone.
- avuserow 11y ago
  Vehicle and person hits cause exceptional delays, but not significantly more so than the string of breakdowns in February. They apologized for this, and seem to have fewer rush hour problems, so maybe this has improved. They could do more to improve the standing room problem, which adds up quickly. My evening train is now perpetually 3-5 minutes late, which adds 10% to the runtime, due to the train in front being overcrowded. They are putting out new timetables for next month that they claim will improve this. Their fix is to move its departure time closer to the slow train in front, and add 3 minutes to the trip duration. Frustrating.

ZanyProgrammer 11y ago

If only Caltrain had a decent API for developers that produced data that is needed for any serious analysis (like train number, speed and lat/long). I hate having to resort to hackey workarounds like scraping for this info. I believe the NextBus API for MUNI has actual positional data and vehicle info. Caltrain, being the mediocre agency it is, has a next to useless API (if I remember the docs correctly on 511.org).

jsweojtj 11y ago
An API would go a long way and realtime information would obviously be awesome. It appears that even if Caltrain provided historical data of actual departure times per train per station, that would be a huge improvement.

mattcaywood 11y ago

Data scientists blog about Caltrain data, come up with convoluted hypothesis about bias in sensors at two stations. Commenter on blog notices that Caltrain is occasionally single-tracking between those stations due to a bridge replacement. [1] "Data science" ends up with a bloody neck from Occam's razor. [1] http://www.caltrain.com/projectsplans/Projects/Caltrain_Capital_Program/San_Mateo_Bridges_Replacement_Project.html http://www.caltrain.com/projectsplans/Projects/Caltrain_Capi...

xivzgrev 11y ago
The data was sound. They formed a hypothesis. They got a better explanation. Now they have a better hypothesis for the data anamoly. I don't think it's fair to fault them or to discredit the effort.
- mattcaywood 11y ago
  I'm criticizing the approach of starting the analysis in a vacuum and coming up with a hypothesis that fits the abstract pattern, when simple domain knowledge (from looking at a website, or a Caltrain station notice board) would have put them on the "right track" from the start. What the authors did falls into the trap of a very stereotypical criticism of data science and doesn't do data science any favors.
lifestil 11y ago
'"Data science" ends up with a bloody neck from Occam's razor.' Heh, I like the imagery. I wouldn't really call it Data Science with capital letters either. It's just plain-old exploratory analysis. I wouldn't say the hypothesis is convoluted, especially since we see bizarre data coming out of Caltrain API at times, and experience has taught us to distrust our instruments when observing strong systematic bias. But single-tracking due to construction IS obviously a better explanation... because it's probably true. What is still confusing is that the train is delayed several minutes, but then recovers at the very next station. That is odd behavior for a train to 'make up' that much time so quickly. Typical behavior is just to keep getting later. Or maybe Occam will strike again in the comments with an obviously correct explanation!