Well, the gamma rays produced by fusion can still photo-desintegrate various elements which in turn leads to secondary neutron radiation and unstable isotopes.

Well, the gamma rays produced by fusion can still photo-desintegrate various elements which in turn leads to secondary neutron radiation and unstable isotopes. I don't know what the cross sections of those interactions are but it's not quite zero.