Passive Houses use active ventilation for just this reason. Mine draws air from outside, runs it through a heat exchange with the air being pumped back outside,

Passive Houses use active ventilation for just this reason. Mine draws air from outside, runs it through a heat exchange with the air being pumped back outside, and through dual HEPA filters. I breathe much more easily now than in the 100 year old home I lived in for the previous ten years.