Obviously anecdotal, but I feel that my success in fields of programming and computer science are precisely because I had _more_ access to advanced math courses

Obviously anecdotal, but I feel that my success in fields of programming and computer science are precisely because I had _more_ access to advanced math courses, not _less_. I started doing symbolic algebra in 4th grade, and by the end of high school I was doing multivariable calculus, which continues to be applicable in my field.