I'd urge you to reexamine now. When your kids are grown up and out of the house and you're a little older you might think "it would have been so easy to go back

I'd urge you to reexamine now. When your kids are grown up and out of the house and you're a little older you might think "it would have been so easy to go back and get my degree then and look where I could have been now." Remember that although rare, there are people getting PhDs in their 60s and 70s.