Most people I know have not bothered to learn any math beyond algebra, and try to forget what algebra they did learn, they still seem to be doing pretty well. Y

Most people I know have not bothered to learn any math beyond algebra, and try to forget what algebra they did learn, they still seem to be doing pretty well. You can always limit yourself and pretend that's "enough" but it can very well be self-limiting. You simply don't know what you don't know, and that includes not knowing all of the things you might miss out on by not studying. Set theory and abstract algebra has a huge range of applications, simply being able to earn a living without studying those things is an insufficient reason to avoid studying them.