My impression is that you don't need eminent domain takings for this, you just need higher level government (e.g., states) to set more rules around how restrict

My impression is that you don't need eminent domain takings for this, you just need higher level government (e.g., states) to set more rules around how restrictive local residential zoning is allowed to be.