You can always come up with some really elegant and expressive formal systems to model programming/computing and thats the mathematics side of things BUT people

You can always come up with some really elegant and expressive formal systems to model programming/computing and thats the mathematics side of things BUT people often ignore the physical/engineering side of things. We need to engineer actual physical systems that can implement those so called elegant formal systems of mathematics. This is where the problem is, engineering a physical systems is a very complex problem with lots of constraints and is not as simple as coming up with a bunch of symbols and rules of a formal system. Physics is about reality and mathematics is about representations, you can create representations from thin air but you cant do that with reality :)