Ask HN: Why don't more websites use HTML 5 Audio for button clicks, etc.?

Curious why more websites don't use what I thought would be one of the more popular HTML 5 features for UI interactions. Would they be annoying? A lot of the games I've played make use of those sounds, and they enhance rather than annoy. What are your thoughts?