I did exactly this. I worked 2 hours per night after the kids went to bed on week nights, and for about 3 hours early on Saturday morning. It took about 10 ye

I did exactly this. I worked 2 hours per night after the kids went to bed on week nights, and for about 3 hours early on Saturday morning. It took about 10 years until I went full time, and I now been doing it full time for 10ish years. It’s possible, but you do have to be patient. In my case I was risk averse so I liked not giving up a good job.