When I see a woman in a hijab, I also tend to look away - but it's because they're worn for modesty and I worry it would be disrespectful to them to "gaze" long

When I see a woman in a hijab, I also tend to look away - but it's because they're worn for modesty and I worry it would be disrespectful to them to "gaze" longer than necessary. Can somebody more familiar with Muslim thinking comment on this? I've visited muslim households where modesty was so important, the women would not even present themselves (however well covered they were dressed) in front of men outside their family. So although this style of hijab is much more "modern" - I still don't want to make a muslim woman feel uncomfortable.