Other settings are per site and this one can be as well - you can select "reject all", "accept all" (or "reject non-essential") and be done with that... or use

Other settings are per site and this one can be as well - you can select "reject all", "accept all" (or "reject non-essential") and be done with that... or use "ask each time" like with mic/camera and there would be small, tiny, browser-ui pop-up in usual place...