2 ms·
I'm wondering if this highlights the area of compiler optimization regarding GPU/SPMD/Vector processors being one behind conventional CPU optimizations. Sure w
by Zenst 11y ago
I'm wondering if this highlights the area of compiler optimization regarding GPU/SPMD/Vector processors being one behind conventional CPU optimizations.
Sure with CPU's you have variety but less so and certainly more dynamic changes over time with SPMD type area's with GPU architectures still changing more generation to generation compared to CPU architectures.
Given that perhaps this highlights that area as an opportunity.
But I suspect the whole area of such a dynamic area with GPU's from 5 years ago at a hardware level being much more different than CPU's with changes that any investment in low-level optimization will be cost wise higher in many cases than just having portability and the ability to easily run on the next generation and gain accordingly.
With this in mind the number of architectures and associated hardware changes more often than the core CPU's and it is perhaps that alone that curtails such optimization process's being able to mature and come into play. Though once things settle down more.
Though I'm mindful this is in many ways the old Betamax VS VHS and from that we learned that it is not always the best technology that progresses with the masses, but the ease of use/cost of attaining and running it. In short perfection rarely wins out in the face of just good enough for a lot less effort in so many cases.