3 ms·
My test harness loads up the original DLL then executes that in parallel against the converted code (differential testing). That closes the feedback loop the LL
by seddonm1 8mo ago
My test harness loads up the original DLL then executes that in parallel against the converted code (differential testing). That closes the feedback loop the LLM needs to be able to find and fix discrepancies.
I'm also doing this on an old Win32 DLL so the task is probably much easier than a lot of code bases.
- measurablefunc 8mo agoWhat are you tracking during the runtime tracing? Or is that written up in your link?
- seddonm1 8mo agoI am applying differential/property based testing to all the side effects of functions (mutations) and return values. The rust code coverage is also used to steer the LLM as it finds discrepancies in side effects. It is written up in my link - please bear in mind it is really hard to find the right level to communicate this level of detail at - so I'm happy to answer questions.
- measurablefunc 8mo agoThat's fine, that answers my question.