But even if you are correct, there could still be civilizations several millions of years older than us. Earth's history would have turned out completely differ

But even if you are correct, there could still be civilizations several millions of years older than us. Earth's history would have turned out completely differently if it wasn't for various asteroid impacts and geological events. The chance of two intelligent species evolving within a few thousand years of each other is pretty low.