I encourage you to stick to your guns on this. I used to have a Nexus 5X (which was a hair too big), and moved to a Moto x4. The x4 is basically the exact same

I encourage you to stick to your guns on this. I used to have a Nexus 5X (which was a hair too big), and moved to a Moto x4. The x4 is basically the exact same size as the 5X, but they went with a "fancy" design for it with metal construction and a glass back. It's much heavier than my previous phone and it's slippery because of the glass construction. It's borderline impossible to use with one hand, and hard to avoid dropping occasionally because it's so much heavier and harder to grasp. It's so slick that it regularly slides off of almost flat surfaces. My next phone will be 5" or less. I have the same size preferences as you, and also owned a Nexus 4. I still think it was the pinnacle of the cell phone form factor.