You can also simply use "that said". I've always taken the phrase "that being said" to be a variation of the phrase "that said" that isn't as assertive of what

You can also simply use "that said". I've always taken the phrase "that being said" to be a variation of the phrase "that said" that isn't as assertive of what was said, relegating it to only "having been said" rather than set in stone