Yes, but shrinking the pie means that finite resources such as housing (land) becomes cheaper. Even if my piece of pie gets smaller in absolute terms I might s

Yes, but shrinking the pie means that finite resources such as housing (land) becomes cheaper. Even if my piece of pie gets smaller in absolute terms I might still be better off than before because the price of housing and domestic services have gone down.