But in the same way it's even somewhat rude if e.g. a billionaire says they don't have money to buy something (assuming it's fairly cheap). It makes a differenc

But in the same way it's even somewhat rude if e.g. a billionaire says they don't have money to buy something (assuming it's fairly cheap). It makes a difference whether they say that they don't have money or that they don't want to spend it. And the whole point of the comment was to say that it is often NOT someone not being able to afford it time-wise.