3 ms·
have you actually tried writing highly optimizer cuda? its really hard. nothing is "for free". a lot of the caching (not all) has to be hand coded. you can see
by hughperkins 10y ago
have you actually tried writing highly optimizer cuda? its really hard. nothing is "for free". a lot of the caching (not all) has to be hand coded. you can see how much attention to detail scott gray puts into his kernels eg at https://github.com/NervanaSystems/maxas https://github.com/NervanaSystems/maxas
- jacquesm 10y agoNot that much harder than writing hand optimized assembly. There are a few more quirks to keep in mind and you need to have the memory lay-out and access patterns down otherwise it will not give you the boost you expect. In a way I really love CUDA for this reason, it allows me to re-cycle all my old optimization skills and do something useful with them.