Layman here. Isn't the big speed penalty in digital electronics the clock speed of the transistors changing state? Not the actual signal going down the wire fro

Layman here. Isn't the big speed penalty in digital electronics the clock speed of the transistors changing state? Not the actual signal going down the wire from gate to gate?