4 ms·
> Whatever you can do to create deterministic gates that the LLM simply must overcome to reach a “done” state, do it. First thing Gemini did when I tried that
by cube00 3mo ago
> Whatever you can do to create deterministic gates that the LLM simply must overcome to reach a “done” state, do it.
First thing Gemini did when I tried that was turn off all the rules in eslint.config.mjs claiming they were "overly stylistic"
Yes, it got better once I explicitly told it not to disable any rules, so I accept I was holding it wrong but I do worry just how many footguns it puts into other things because I didn't know the right guardrails to give it.
- p_kuni 3mo agoWhy does your harness allow the LLM to generate output that can disable rules & checks?
- cube00 3mo agoI have no idea because Google Antigravity is closed source.
- p_kuni 3mo agoAlthough I don't use it, Antigravity should be configurable to prevent reads / writes to certain files. You should definitely do that and ideally configure a hook to automatically run the linter after the LLM completes, then feed it back to the LLM if it's red. Don't prompt your agent to do stuff, build your loop in a deterministic manner.
- Atotalnoob 3mo agoAdd hooks to block it from being able to edit the files you don’t want changed.