My vague understanding is that the draft also helps -- the fire pulls the (hot) air out through the chimney, and fresh air gets pulled into the house to replace

My vague understanding is that the draft also helps -- the fire pulls the (hot) air out through the chimney, and fresh air gets pulled into the house to replace it. The house may not be any cooler than the outside, but it at least isn't (much) hotter.