There are two important points the comments are somewhat missing: On a chip there is now lots of redundancy to ensure chip functions correctly. This gets worse

There are two important points the comments are somewhat missing: On a chip there is now lots of redundancy to ensure chip functions correctly. This gets worse as variation at smaller geometries increases. So over margining because no one wants another floating point bug. Design effort and cost is a huge issue too. Margins at chip companies are shrinking - design automation license costs, large runtimes and much more difficult verification process from design to fab to test. A new programming paradigm where there is a certain probability of error can be tolerated should go a long way in making the underlying hardware much more efficient.