I think it might be simply because the risk to the person doing the hitting is much greater given they're not covered in pads/helmets. People still get wrecked

I think it might be simply because the risk to the person doing the hitting is much greater given they're not covered in pads/helmets. People still get wrecked in rugby, but I think there are less battering-ram style hits.