Are there alternative solutions to this problem, that are not interesting for industry, but feasible for hackers? E.g.: remove those two capacitors that bridge

Are there alternative solutions to this problem, that are not interesting for industry, but feasible for hackers? E.g.: remove those two capacitors that bridge the primary and secondary sides of the power supply. Tingle is now gone, but the supply is now emitting a lot of EMF noise. How about arresting that with some bulky ol' ferrite cores?