What's the problem with "fossil fuel clothing" though? They don't burn the fuel to make the clothing, rather the opposite: this can now no longer be burned and

What's the problem with "fossil fuel clothing" though? They don't burn the fuel to make the clothing, rather the opposite: this can now no longer be burned and turned into CO2 because it's on your body. Is it somehow pollutive to make oil products even if you don't burn them? And I mean more so than the alternative of course, because I get that so much as pumping up the oil costs energy. If it's just about the irony of wearing the biggest problem we're facing as a garment and not a real question then I see the point.