I guess it depends on how comfortable you are with what the speaker is saying. If you are not sure you agree or you want to think about something else, then it'

I guess it depends on how comfortable you are with what the speaker is saying. If you are not sure you agree or you want to think about something else, then it's normal to look away.