Why does a busy life put a less busy life "to shame"? I'm not sure if you meant it literally, but I do know a lot of people who do. They literally get offended

Why does a busy life put a less busy life "to shame"? I'm not sure if you meant it literally, but I do know a lot of people who do. They literally get offended and defensive if I suggest they have some free time to do something. But there really isn't anything shameful about successfully budgeting time, just as there isn't anything shameful about having spare money left over from your paycheck. Quite the opposite, actually.