3 ms·
You have a different agent write the tests and another run the tests. You tell them each that they aren’t checking their own work, they’re checking someone else
by az226 8mo ago
You have a different agent write the tests and another run the tests. You tell them each that they aren’t checking their own work, they’re checking someone else’s. You can tell them to be skeptical. Then you can also tell them that don’t fail the code for no reason, because a third agent will be checking your tests and you will be penalized for inaccurate testing.
This approach balances out and maximizes accuracy.
- otabdeveloper4 8mo ago> just use psychological tricks on the LLM, bro, you'll cajole it into not hallucinating Can't help but chuckle at that.
- bheadmaster 8mo agoIf it sounds stupid but it works, it's not stupid.
- otabdeveloper4 8mo ago> but it works Proofs?
- bheadmaster 8mo agoTry it yourself and report back the results.