When gaming, as long as I don't have a lot of software running on the host, pipewire works great with pulse passthough, starts crackling if I run FF on the host

When gaming, as long as I don't have a lot of software running on the host, pipewire works great with pulse passthough, starts crackling if I run FF on the host, I guess something to do with nice levels