4 ms·
In the "test setup", it says: "a t3a.micro" and "a t4g.micro". To me, this implies they used a single ec2 instance of each size. However, ec2 instance p99s or
by TheDong 3y ago
In the "test setup", it says: "a t3a.micro" and "a t4g.micro".
To me, this implies they used a single ec2 instance of each size. However, ec2 instance p99s or so can be impacted by "noisy neighbors", especially on the burstable types which are intentionally oversubscribed.
It's still useful to know if, for example, t4gs are more prone to noisy neighbors, but with only 1 instance as a datapoint, you simply can't tell if it was bad luck or not.
I think this test would be much better with either only dedicated instance types, or by running it with a large n such that an individual unlucky/noisy-neighbor doesn't influence the results overtly.
- kylegalbraith 3y agoThis is the first thought I had as well. The t3/t4 class is notoriously problematic when you get to reasonable loads because of their burstable nature. Still an interesting test, but it would be better on a general instance class.