You're missing the part about layered controls which is what elevator access control is. Limiting the number of people who can incidentally travel to and loite

You're missing the part about layered controls which is what elevator access control is. Limiting the number of people who can incidentally travel to and loiter outside your primary office entrance is one level of control - it raises the visiibility of interlopers, and creates an initial barrier to even being near the objective. Everything else you've listed though is also just a big list of additional breaches and crimes someone would have to commit before they can even get near to the target in the first place - i.e. they're relevant, but if you're ingress plan is "steal a bunch of elevator access keys" then you've already excluded a whole host of simple crimes of opportunity.