I've never worked for a startup, but I've always had an aversion to vacation. It's not that I don't like going places or enjoying myself, but I hate being away

I've never worked for a startup, but I've always had an aversion to vacation. It's not that I don't like going places or enjoying myself, but I hate being away and I hate not being involved and getting things done. A good vacation for me is a day off to relax here and there, or a weekend away. Taking more than 3 days at a time always seems like too much and I end up wanting to get back. I still need to take that week long vacation every year for the enjoyment of my wife and kids, but it seems too long.