Imagine you bought a home, and 10+ years after you bought it, not the previous owner, but the owner before that comes to take the chimney off the house because

Imagine you bought a home, and 10+ years after you bought it, not the previous owner, but the owner before that comes to take the chimney off the house because they had a clause in the contract between the previous two owners where the chimney was not part of the sale. This was not in your contract. You gonna let the original owner take his chimney over some deal that happened a decade ago that you had no idea about?