In my experience (and wikipedia), mud daubers aren't aggressive. You may have misidentified a species or had an uncommon experience. They prey on spiders so I

In my experience (and wikipedia), mud daubers aren't aggressive. You may have misidentified a species or had an uncommon experience. They prey on spiders so I consider them beneficial. Only real issue with them is that they clog up mechanisms with mud.