Flawed benchmarks. If target produces errors during the test, the result should be invalidated immediately. You can't compare data from failed result to anothe

Flawed benchmarks. If target produces errors during the test, the result should be invalidated immediately. You can't compare data from failed result to another failed result or a normal one. In instances where flask/django started to output errors, the test case should have been adjusted until they could have completed operations. Otherwise you can't compare the results, since you have no baseline. What this test tells me now is XY gives errors for this test while Z seems to process it. That's not a benchmark of any sort.