3 ms·
A staged roll out (with a/b test manner with equal control/experiment arms) and monitoring of health metrics would totally catch this.
by tehlike 9y ago
A staged roll out (with a/b test manner with equal control/experiment arms) and monitoring of health metrics would totally catch this.
- michaelt 9y agoA staged roll out would mean only 5% of customers' cars lost their radio, navigation, climate control and rear-view camera. I'll admit that's better than 100%, but it's still garbage. Where was the pre-release testing?
- tehlike 9y agoWhy not start with 1 car, 10 cars, 0.1% and beyond. My point is prerelease testing can only catch so much. you can think of many bugs that affected only people with certain settings etc. It is hard to replicate all the conditions appearing in the wild. This could be as simple as "last software/firmware version", or as complex as "car stalls as it makes a u turn". Hard to test all these.