Is there a way to make Cmd+Tab work with fullscreen windows? If I can't remember if I've made an app fullscreen, I have to three-finger swipe up to see the list

Is there a way to make Cmd+Tab work with fullscreen windows? If I can't remember if I've made an app fullscreen, I have to three-finger swipe up to see the list of maximized applications and if it's not there, start Cmd-Tabbing to find it. Because I don't use macOS exclusively, what often happens is I try to Cmd+Tab, can't find the window, assume I'm not actually running the software I think I am and then eventually discover it's fullscreen somewhere. I'd really love to find a way to be able to Cmd+Tab through all windows, fullscreen or otherwise.