I'm still on KitKat, but I think you can swipe down over the notification to open up a dismiss option underneath the notification. (at least you can on kitkat,

I'm still on KitKat, but I think you can swipe down over the notification to open up a dismiss option underneath the notification. (at least you can on kitkat, I swipe down over 3 alarms at once and dismiss them all)