I think most popular browsers support badges in standard mode (no extension or webapp mode needed). A fallback would be to change the favicon and/or the window

I think most popular browsers support badges in standard mode (no extension or webapp mode needed). A fallback would be to change the favicon and/or the window title and tab color.