3 ms·
I haven't blogged about this yet, but we saw a 1000x fold speed-up doing several things around symbolication. The more optimal approach we found was to use the
by vlovich123 5y ago
I haven't blogged about this yet, but we saw a 1000x fold speed-up doing several things around symbolication. The more optimal approach we found was to use the gimli crate[1] directly & carefully optimize it to read in the data structures for the executable(s) you are symbolicating upfront & then issuing in-process queries. They also have a drop-in replacement of addr2line that outperforms it (both in symbolication speed & memory usage).
I am curious about how that compares with libbfd since that wasn't under consideration for us as it uses GPLv3.
[1] https://github.com/gimli-rs/gimli https://github.com/gimli-rs/gimli
[2] https://github.com/gimli-rs/addr2line https://github.com/gimli-rs/addr2line
- tonyg 5y agoSteinar Gunderson (who suggested [1] the talk-through-a-pipe approach) just now compared [2] the `libbfd` variant to the pipe-to-`addr2line` version, and found them to take similar amounts of time. This agrees with what I saw in `top` while testing: with the patch, I see `perf` using ~95% CPU, with `addr2line` using the remaining ~5%. So speeding up `addr2line` probably wouldn't result in very much of an overall improvement for this workload. [1]: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=911815#28 https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=911815#28 [2]: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=911815#38 https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=911815#38
- vlovich123 5y agoThe piping is a good chunk of the gain but the gimli library is still much faster than addr2line & uses less memory if used correctly. Since libbfd shows similar results, I'm thinking there might be a speed bump from switching to use it (some care has to be taken to preserve 0-copy semantics across FFI).
- tonyg 5y agoIt'd definitely be interesting to find out!
- vient 5y agoLooks interesting. I've encountered some annoying bugs with latest addr2line when trying to get symbols for addresses, wonder how gimli performs in that sense. Also, it seems that addr2line 2.37 has some performance regressions compared to 2.36.1 which I didn't look at yet.
- vlovich123 5y agoIn my experience gimli also symbolicated things addr2line couldn't.