Because what is the CPU supposed to do if you divide zero by zero or take the square root of -1? It's actually not exactly a decision being made by the languag

Because what is the CPU supposed to do if you divide zero by zero or take the square root of -1? It's actually not exactly a decision being made by the language designers. The IEEE standard governs the floating point logic embedded in ALU hardware. Programming languages tend to expose floating point math in its rawest form for performance reasons.