4 ms·

Okay, I don't get it. Why not hook this into LLVM's compiler infrastructure, instead of recovering the CFG from a binary - and not any binary, but one that has

by q3k 7y ago

Okay, I don't get it. Why not hook this into LLVM's compiler infrastructure, instead of recovering the CFG from a binary - and not any binary, but one that has to built with special flags anyway? This seems backwards.

convolvatron 7y ago
you're absolutely right. it seems like a huge number of comilers have had 'global optimization' on their todo list, but never got around to it. i think this paper (cant find a non-paywalled copy) https://dl.acm.org/doi/10.1145/12276.13338 https://dl.acm.org/doi/10.1145/12276.13338 got around 10% just by attempting to align the allocation of the callers and the callee. maybe memories are large enough now, and the whole proprietary binary-only library business model is gone, that we should really be abandoning the idea of seperate compilation units as the default.
deleted 7y ago
[deleted]
marklacey 7y ago
Because if you statically link libraries like the language runtime it allows you to reorder the blocks in those as well to improve locality and instruction cache utilization. For example if your code calls a particular runtime function shortly after starting, that function (or the basic blocks from that function that are executed frequently) can be placed close to the call site.
- ndesaulniers 7y ago
  If you're statically linking, then LTO would give you cross TU visibility to do the same optimization at link time, not post link when you've lost a lot of fidelity.
  - marklacey 7y ago
    Not if it’s a library that you’re not compiling, like language runtimes or system libraries. LTO requires that you’re compiling all the code to get the benefits. I’m also not sure if either gcc or clang’s LTO does layout at the basic block level or at the function level. There is a lot of benefit from doing it at the basic block level. You can literally lay out all the code that runs at application start time so that it is mostly adjacent and fall-through from block to block during execution. This isn’t something you necessarily do instead of LTO, but rather something you can do in addition to it.
ndesaulniers 7y ago
This is the argument the authors of propeller make.
thedance 7y ago
What if your binary, or one of its libraries, is not built with LLVM?

by q3k 7y ago

convolvatron 7y ago

you're absolutely right. it seems like a huge number of comilers have had 'global optimization' on their todo list, but never got around to it. i think this paper (cant find a non-paywalled copy) https://dl.acm.org/doi/10.1145/12276.13338 https://dl.acm.org/doi/10.1145/12276.13338 got around 10% just by attempting to align the allocation of the callers and the callee. maybe memories are large enough now, and the whole proprietary binary-only library business model is gone, that we should really be abandoning the idea of seperate compilation units as the default.

deleted 7y ago

[deleted]

marklacey 7y ago

Because if you statically link libraries like the language runtime it allows you to reorder the blocks in those as well to improve locality and instruction cache utilization. For example if your code calls a particular runtime function shortly after starting, that function (or the basic blocks from that function that are executed frequently) can be placed close to the call site.

ndesaulniers 7y ago
If you're statically linking, then LTO would give you cross TU visibility to do the same optimization at link time, not post link when you've lost a lot of fidelity.
- marklacey 7y ago
  Not if it’s a library that you’re not compiling, like language runtimes or system libraries. LTO requires that you’re compiling all the code to get the benefits. I’m also not sure if either gcc or clang’s LTO does layout at the basic block level or at the function level. There is a lot of benefit from doing it at the basic block level. You can literally lay out all the code that runs at application start time so that it is mostly adjacent and fall-through from block to block during execution. This isn’t something you necessarily do instead of LTO, but rather something you can do in addition to it.

ndesaulniers 7y ago

This is the argument the authors of propeller make.

thedance 7y ago

What if your binary, or one of its libraries, is not built with LLVM?