I think this is what end-to-end models will be best at, since they'll be able to account for far more environmental factors than a manually written planner flip

I think this is what end-to-end models will be best at, since they'll be able to account for far more environmental factors than a manually written planner flipping between the stop light deceleration curve and car-ahead curve constantly, for example.