I don't think he's suggesting that they _should_ default to lack confidence, but rather that many are very self-conscious about it, so it's probably even more

I don't think he's suggesting that they _should_ default to lack confidence, but rather that many are very self-conscious about it, so it's probably even more difficult for him. Hence, his performance is even more impressive.