4 ms·

What else could regulations call for than a defined set of tests? You need comparability between tests or the tests are worthless when it comes to informing cus

What else could regulations call for than a defined set of tests? You need comparability between tests or the tests are worthless when it comes to informing customers. Real world crashes differ wildly, so it's impossible to use those as a measure. There are also many different crash tests carried out around the globe and a car performing well in many of those will perform well in the real world.

csours 10y ago
Use a defined set of tests along with real world metrics. [1] Ensure your tests match reality as close as possible. Ensure you test for the most important events found in the real world. In the case of crash tests, make sure you test for crashes that often cause death or serious injury. Real world metrics get really tricky and expensive, but when speaking about life and safety, it's probably important enough to measure. It's also very important to be smart about measurement and reporting of events, statistics, and trends. 1. http://lesswrong.com/lw/1ws/the_importance_of_goodharts_law/ http://lesswrong.com/lw/1ws/the_importance_of_goodharts_law/
- Xylakant 10y ago
  But that's exactly what happens: crash tests get validated against real world accidents and refined all the time.
  - csours 10y ago
    Is that a problem? That sounds like a solution... but it's a continuous solution, not a solution that you apply once and forget about.
hammock 10y ago
Goodwin's law outlines a paradox. Practically, there is no perfect metric; every metric has a limited shelf life.