4 ms·
Formal verification gets you to deploy with confidence but it's still a snapshot. What happens when real-world inputs drift from what you tested against? The su
by laalshaitaan 8mo ago
Formal verification gets you to deploy with confidence but it's still a snapshot. What happens when real-world inputs drift from what you tested against? The subtler problem is runtime behavioral drift: an agent that's technically correct but consistently misunderstands a whole class of user queries is invisible to any pre-deploy check. Pre-deploy and post-deploy verification are genuinely different problems.
- hackyhacky 8mo ago> What happens when real-world inputs drift from what you tested against? The whole point of formal verification is that you don't test. You prove the program correct mathematically for any input. > an agent that's technically correct but consistently misunderstands a whole class of user queries is invisible to any pre-deploy check The agent isn't verifying the program. The agent is writing the code that proves the program correct. If the agent misunderstands, it fails to verify the program.