I've never had to do that, guests get access to the playback controls while on my network and are completely free to use their own phone to cast something else

I've never had to do that, guests get access to the playback controls while on my network and are completely free to use their own phone to cast something else to my TV if they wish. What they don't get access to is my own media library.