We have a “poor man’s” version of this running as a GitHub Action on our PRs[0]. It basically just takes the diff from the PR and sends it to GPT-4o for analys

We have a “poor man’s” version of this running as a GitHub Action on our PRs[0]. It basically just takes the diff from the PR and sends it to GPT-4o for analysis, returning a severity (low/medium/high) and a description. PRs are auto-blocked for high severity, but can be merged with medium or low. In practice it’s mostly right, but definitely errs on the side of medium too often (which is reasonable without the additional context of the rest of the codebase). With that said, it’s been pretty useful at uncovering simple mistakes before another dev has had a chance to review. [0] https://magicloops.dev/loop/3f3781f3-f987-4672-8500-bacbeefca6db/view https://magicloops.dev/loop/3f3781f3-f987-4672-8500-bacbeefc...