4 ms·
How do they test this?
by crispyporkbites 7y ago
How do they test this?
- judge2020 7y agothis commit[0] might be what's referenced, and this[1] looks to be the test that Google runs (not sure if this is ran in CI, or only done anecdotally for when performance tests[2] show issues). 0: https://github.com/chromium/chromium/commit/208f274e4bcb51748bba83071aa70011ceafa385 https://github.com/chromium/chromium/commit/208f274e4bcb5174... 1: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/refs/heads/master/client/site_tests/power_LoadTest/README.md https://chromium.googlesource.com/chromiumos/third_party/aut... 2: https://chromeperf.appspot.com/ https://chromeperf.appspot.com/
- saghul 7y agoNever heard of [1] before. Impressive stuff.
- robocat 7y agoHere is an example bug that had an unobvious cause (they just reverted the diff out in the end!): https://bugs.chromium.org/p/chromium/issues/detail?id=520952 https://bugs.chromium.org/p/chromium/issues/detail?id=520952 Bisect job status: Completed Bisect job ran on: android_nexus9_perf_bisect ===== BISECT JOB RESULTS ===== Status: Positive: Reproduced a change. Test Command: tools/perf/run_benchmark -v --browser=android-chromium --output-format=buildbot --also-run-disabled-tests power.android_acceptance Test Metric: energy_consumption_mwh/energy_consumption_mwh Relative Change: 150.95% (+/-1.88%) Estimated Confidence: 99.90% Retested CL with revert: No Pretty graphs now deleted.