Not necessarily. The servers can communicate between themselves so it doesn't matter which server the clients connects to. On GCP there's PubSub [1]. Of course

Not necessarily. The servers can communicate between themselves so it doesn't matter which server the clients connects to. On GCP there's PubSub [1]. Of course this is much slower than shuffling bytes in memory in the same process. It also moves some complexity from service-discovery and into the backed architecture. [1] https://cloud.google.com/pubsub/ https://cloud.google.com/pubsub/