9 ms·
Panopticon: A libre, cross platform disassembler for reverse engineering
- dikaiosune 11y agoRequisite Rust fanboy'ing: GitHub stats say 90% Rust code.
- steveklabnik 11y agoThe author posted on /r/rust with some details: https://www.reddit.com/r/rust/comments/4ihtfa/panopticon_a_libre_crossplatform_disassembler/d2yj305 https://www.reddit.com/r/rust/comments/4ihtfa/panopticon_a_l... A particularly interesting comment: > Also I found iterator invalidation bugs simply by translating > C++ to Rust, thanks Borrow Checker!
- pcwalton 11y agoYeah, it's really interesting how many iterator invalidation bugs you find in real C++ codebases. It's so easy to think that they don't exist until you have a tool (or a human) actively searching for them…
- dman 11y agoIsnt this whole category of bugs easily avoided by using 1. _SECURE_SCL on windows 2. _GLIBCXX_DEBUG on glibc based toolchains
- Someone 11y agoThose do not remove any bugs; it just changes how they are handled (ignore and hope for the best vs print diagnostic and terminate program, and the latter not in all cases)
- dman 11y agoAssuming that tests exist, and have good coverage, wont the checked iterator implementations mentioned above catch most issues with invalid iterators?
- dikaiosune 11y agoA big part of what makes Rust great is that it catches those issues at compile-time, no test coverage required, no extra run-time checks required (not that it moots tests, of course). In my experience so far this is a very powerful ally to have when writing software, as it's very useful to surface those issues as early as possible. EDIT: Also: > Assuming that tests exist, and have good coverage That's a very big assumption. Granted my current job is often to clean up codebases that are the opposite of that, so maybe I've got a bias here.
- pcwalton 11y agoI don't know of any large, widely used, security critical, heavily scrutinized C++ program that uses those flags in production. I also don't know of any such C++ program that hasn't had game-over use after free bugs. So the answer to your question is somewhere ranging from "we don't know, but unlikely" to "no".
- Someone 11y agoFor some definition of ‘good coverage’ and ‘most’: yes. I do not think 100% coverage on the code you write alone is enough to get to ‘all', though. For example, if your test declares a vector and calls a function that does v.erase( i, v.end()); with i == v.end(), you get 100% coverage, but in production, that part of the code might be called with i == v.begin(), and that invalidates all iterators on the vector.
- pcwalton 11y agoNo. You can dereference those "safe" iterators into dangling references.
- deleted 11y ago[deleted]
- aantix 11y agoOn a side note; the visual callgraph is interesting.. It'd be interesting for other IDEs to implement something similar with a historical listing of input/output values for the corresponding displayed methods.
- deleted 11y ago[deleted]
- searine 11y ago>Panopticon Good lord what a cliche name.
- martanne 11y agoDoes somebody know how it compares to radare2?
- miles 11y agoFrom their GitHub repository[1]: "Panopticon is under heavy development and its feature set still very basic. It's not yet able replace programs like radare2 and IDA Pro. We are working on it, check back regularly!" [1] https://github.com/das-labor/panopticon/blob/master/doc/feats.rst https://github.com/das-labor/panopticon/blob/master/doc/feat...
- umanwizard 11y agoAnyone know how this compares to IDA Pro ?
- busterarm 11y agoIf you can afford an IDA Pro license and cost of plugins, does it matter?
- umanwizard 11y agoYeah, it matters. If this is better, I'll use this; if IDA is better, I'll use IDA. I'm not 100% sure I understand your comment. Btw, most companies can afford an IDA license. It's pretty cheap compared to the salary of a developer, at least in the coastal US.
- joshuamcginnis 11y agoLet's assume you have reversed engineered some kind of boolean check and you now want to patch it to always return true or false. What does that process look like at a high level?
- tomf64 11y agoYou insert the equivalent of "mov eax, 0x1; ret" (or 0x0) in x86 for whatever architecture you're using as the first instructions of the function.
- joshuamcginnis 11y agoI mean even more high level than this. If I open a binary, can I just write the new machine code to it directly and not be concerned with recompiling?
- SCHiM 11y agoAs long as all the instructions are the same size (or smaller padded with no-operation instructions) then yes. If, however, you do change the size of the application all relocation deltas need to be changed, and all relative jumps and calls need to be recalculated.
- georgiecasey 11y agoi was trying to edit one byte in an ELF, no change in file size and it kept crashing. i read that each section of code is hashed and obviously my byte edit changed the hash. i was pretty out of my depth tbh.
- ndesaulniers 11y agoSometimes code will add additional checks such as hashes to verify that parts of the text section haven't been modified. Should be able to remove those checks, too. Just have to track them all down.
- partycoder 11y agoI like "ht editor".
- khan20 11y agoAuthor here. Panopticon grew out of my frustration about the lack of usable implementations of cutting-edge program analysis research and the fact that the industry standard for RE is a proprietary software that looks like Windows 95. I toyed with the idea of rewriting it in Rust since 1.0 became stable. The whole port took around 3 months. I got the size down from 10.000 to 8.000 loc. Looking back it was the right decision. Programming in Rust is not only more fun, it's definitely easier too. Panopticon used alot sum types that were implemented using boost::variant. Like everything with Boost it kind of worked but was incredible ugly and complex. Replacing them with enums was probably the biggest reason I switched to Rust. Also I found iterator invalidation bugs simply by translating C++ to Rust, thanks Borrow Checker!
- jbaviat 11y agoGreat work. Therefore that's one more disassembler in the wide. Some of the great open source ones, reverse oriented, that I have been able to test are: Metasm: https://github.com/jjyg/metasm/ https://github.com/jjyg/metasm/ Radare: http://radare.org/ http://radare.org/ Capstone: http://www.capstone-engine.org/ http://www.capstone-engine.org/ Capstone is based on LLVM, that you cannot beat in term of architectures and industrial quality, and has great plugins, which make it kind of my favorite. Of course, for non-scripting needs, you need decent graphical interfaces, as provided by these ones: IDA: https://www.hex-rays.com/products/ida/ https://www.hex-rays.com/products/ida/ Hopper: http://www.hopperapp.com/ http://www.hopperapp.com/ IDA is clearly the best, but Hopper is a fair choice if you need it and you can't afford IDA license for personal use. [Edit: add forgotten IDA and Hopper...]
- flanfly 11y agoMedusa: https://github.com/wisk/medusa https://github.com/wisk/medusa x64dbg: http://x64dbg.com/ http://x64dbg.com/ Bindead: https://bitbucket.org/mihaila/bindead/overview https://bitbucket.org/mihaila/bindead/overview
- tropo 11y agobinaryninja: https://binary.ninja/ https://binary.ninja/
- kayamon 11y agoFYI you most definitely can beat LLVM in terms of quality. Its diassembler was designed originally only to support the instructions that the compiler could generate. While they've since filled out most of the instruction set, there are still a whole set of subtleties it can't deal with well, simply because the compiler part of it was never designed to output them. (e.g. see segment prefixes)
- deleted 11y ago[deleted]
- jbaviat 11y agoIt depends on what you are looking to achieve. If you take a look to e.g. McSema https://github.com/trailofbits/mcsema https://github.com/trailofbits/mcsema, these guys have been able to use LLVM to transform assembly back to LLVM intermediate representation (IR). The IR is an abstract language used by LLVM during compilation to optimize the generated code. Being abstract basically allows to use optimizers across all LLVM supported architectures. In these terms, I think LLVM has a clear advantage over competitors. The following blog post give a nice overview of the McSema achievements: http://blog.trailofbits.com/2014/06/23/a-preview-of-mcsema/ http://blog.trailofbits.com/2014/06/23/a-preview-of-mcsema/
- munin 11y agoI noticed that this only supports AVR. what is your plan to support x86? would you think about linking against some external code that provides semantics for x86?
- flanfly 11y agoThe README is a bit out of date. It support MOS 6502 and parts of x86_64 too. I currently writing the lifting code that translates x86 opcodes to a simpler intermediate language: https://github.com/flanfly/panopticon/blob/feature/rreil/lib/src/amd64/semantic.rs https://github.com/flanfly/panopticon/blob/feature/rreil/lib...
- munin 11y agogodspeed! that's hard work, especially if you want to deal with MMX/SSE and the FPU.
- rvense 11y agoHow do you find adding new architectures to it? I've been meaning to add some architectures I want to Radare for a while now, but it's a bit daunting due to lack of docs and the build system is argh. And I've also been wanting to learn Rust, so this seems like an obvious fit for me...
- flanfly 11y agoPanopticon includes a simple disassembler framework. The basic idea is that you provide opcode patterns akin to regexp and write a function that emits mnemonics and code describing opcode semantics. There isn't much documentation, but you can take a look at the AVR and MOS 6502 disassemblers in lib/src/mos resp. lib/src/avr.
- teacup50 11y agoGPL means I can't use it as a library unless I also GPL. No thanks.
- chris_wot 11y agoYou could ask them to make an exception: http://www.gnu.org/licenses/gpl-faq.en.html#LinkingOverControlledInterface http://www.gnu.org/licenses/gpl-faq.en.html#LinkingOverContr...
- bogomipz 11y agoThe project states: "Panopticon is a disassembler that understands the semantics of opcodes. This way it's able to help the user by discovering and displaying invariants that would have to be discovered "by hand" in traditional disassemblers." Doesn't every disassembler have to understand the opcode semantics in order to disassemble and make sense of them or am I misinterpreting that statement? Also can anyone explain what the "invariants" are? When I hear the word I can only think of loop invariants and I'm guessing that is not what the author means here.
- hcs 11y agoYou say "in order to disassemble and make sense of them", but the "sense" that a disassembler makes can just be the direct conversion from machine code to equivalent assembley. Machine code is just another syntax, directly converting that into assembly can happen instruction-by-instruction. Making more sensible assembly that a human would write is another thing, if you want to follow jumps to figure out where instructions are and regenerate labels, then that's one step towards semantics. I don't know what kinds of invariants panopticon is looking at, but there seems to be code for static analysis using abstract interpretation[1]. This could do the data-flow analysis, determine types and recognize persistent variables. [1] https://en.wikipedia.org/wiki/Abstract_interpretation https://en.wikipedia.org/wiki/Abstract_interpretation
- bogomipz 11y agoNow I see. Thanks for the explanation. this is pretty neat then. Seems like a great learning tool
- chris_wot 11y agoWhat is the best guide to learning how to reverse engineer programs?
- DarkLinkXXXX 11y agoI suggest "Reverse Engineering For Beginners"[1] and "Hacking the Xbox"[2]. [1]: http://beginners.re http://beginners.re [2]: http://libgen.io/book/index.php?md5=64E13DD5E86FE633A48C2261CBF505E2 http://libgen.io/book/index.php?md5=64E13DD5E86FE633A48C2261...
- simplexion 11y agoI like the About me: Hey I'm Kai Michaelis, I'm in an IT-Security Masters program in Bochum, Germany and work part-time for people who use the term Cybersecurity unironically.
- shabbyrobe 11y agoSlightly OT, but are there any good libre tools for reverse engineering binary file formats rather than executables?
- pfalcon 11y agoStart with binwalk.