4 ms·
one of the contributors here. we have a statistical test script we can run on our branches to test the compile time, cost and reliability. we want to try tree o
by pombo 3y ago
one of the contributors here. we have a statistical test script we can run on our branches to test the compile time, cost and reliability. we want to try tree of thought and also something like https://www.reddit.com/r/ChatGPT/comments/14d7pfz/become_god_like_prompt_engineer_with_this_one/ https://www.reddit.com/r/ChatGPT/comments/14d7pfz/become_god.... that said, we found that when we asked GPT to first explain why a test case is failing and then to correct that failure instead of just asking it to correct the failure, unexpectedly costs went up and reliability went down
- ISV_Damocles 3y agoBtw, here's the test job: https://github.com/alantech/marsha/blob/main/.github/workflows/time.yaml https://github.com/alantech/marsha/blob/main/.github/workflo... And the core script for the job: https://github.com/alantech/marsha/blob/main/marsha/.time.py https://github.com/alantech/marsha/blob/main/marsha/.time.py