I think you are right. One reason is that people are first taught maths in primary schools where most teachers are generalists who like art and literature, but

I think you are right. One reason is that people are first taught maths in primary schools where most teachers are generalists who like art and literature, but dislike maths. People start by regarding maths as a chore forced on them, so never enjoy it, and the rest follows from that.