You are pretty close. It's the curvature of the surface area. Smaller black holes have a less ... homogenous orbital space near the event horizon. More tidal

You are pretty close. It's the curvature of the surface area. Smaller black holes have a less ... homogenous orbital space near the event horizon. More tidal forces, etc, so a particle-antiparticle production would be more likely to be torn apart.