This pencil and paper approach to breaking up work is good at parallelizing things that don't appear parallelizable at first glance, e.g. prefix sum [1]. Compil

This pencil and paper approach to breaking up work is good at parallelizing things that don't appear parallelizable at first glance, e.g. prefix sum [1]. Compilers are good at identifying opportunities to reorder instructions in ways that break low level data dependencies. They tend to miss the big higher level opportunities like this. [1] https://en.wikipedia.org/wiki/Prefix_sum#:~:text=A%20work%2Defficient%20parallel%20prefix,%2C%20z2%2C%20.. https://en.wikipedia.org/wiki/Prefix_sum#:~:text=A%20work%2D....