3 ms·
> Myself, I think tests and debugging go together like peanut butter and jelly. That is, you use tests to set up a situation you want to debug The hardest thin
by ai-christianson 2y ago
> Myself, I think tests and debugging go together like peanut butter and jelly. That is, you use tests to set up a situation you want to debug
The hardest things are the ones that come up in prod/after it is already deployed and there's no obvious error message or indication something is wrong.
E.g. rn, I'm building a SWE agent (https://ra-aid.ai https://ra-aid.ai), and running it against SWE-bench lite. The processes will run for 5+ hours and then randomly hang.
So for stuff like this, I rely heavily on:
1) Verbose logging
2) Tools that let you inspect/debug running processes, e.g. py-spy.