3 ms·
Too many benchmark comparisons focus on the best single run. Looking at consistency over time seems to me much more useful than chasing the highest peak perform
by petrostsolis 3mo ago
Too many benchmark comparisons focus on the best single run. Looking at consistency over time seems to me much more useful than chasing the highest peak performance.
- gsgreen 3mo agoTotally agree. The highest benchmark number is easy to chase. We're more interested in answering a different question: "If I deploy this same VM again next week, what should I expect?" That's the whole reason we keep rerunning the same clusters over time.