So assuming an efficient implementation and including high availability requirements: probably in the order of tens of machines, maybe hundreds but not thousand

So assuming an efficient implementation and including high availability requirements: probably in the order of tens of machines, maybe hundreds but not thousands. Edit: eastdakota's tweet says 13% of the requests are https- or tls-encrypted. That throws a spanner into these calculations.