4 ms·
Grammars of Formal Uncertainty
- pizza 1y agoThis seems like the type of work that, whether or not it itself is profound (which I believe it seems it is), will accelerate the forthbringing of derivative works that will definitely be profound.
- molmoai 1y agoElegant indeed. Bridges the formal and probabilistic paradigms
- ImportTshirts 1y ago[dead]
- molmoai 1y agoBrings out a refreshing perspective to LLM guarantees. Very good work.
- lou1306 1y agoI do not see much backing to the claim LLMs can "democratize" formal methods, given that their specifications likely still have to be proof-read by an actual expert. There's also the issue that plain assertion-checking will only take you so far: formal specifications typically need to account for the passing of time, and then the tailoring of the verification platform to the system, rather than property specification, is what usually takes the most effort. But the general approach to uncertainty and connections to OoD detection do sound interesting.
- phoenixrecruit 1y agoGreat breakdown—PCFG-based uncertainty metrics seem like exactly what we need to make LLM-SMT pipelines robust and reliable!