4 ms·
>"Constraints are continuously respected by the AI and can be used to synchronize state and behavior" That seems a rather ... grandiose claim, does it not?
by warrenm 3y ago
>"Constraints are continuously respected by the AI and can be used to synchronize state and behavior"
That seems a rather ... grandiose claim, does it not?
- michaelmior 3y agoAgreed. I would guess that what's actually happening is that the state is forced to respect the constraints by appropriately interpreting the AI output. If that is the case, it seems a stretch to say the AI "respected" anything.
- cosmojg 3y agoYou might be able to enforce constraints through logit manipulation, essentially a logical extension of Top-K/Top-P with a more complex conditional ruleset rather than (or in addition to) a probabilistic one. Also, in most models, logits go through a normalization stage where, theoretically, a lot more can happen than just normalization. All of that said, I have no idea how, or even whether, SudoLang achieves this.
- omneity 3y agoSudoLang seems to target a specification that is likely to work across LLMs without pretraining or special tooling, and as such I don't see much about logit manipulation in this project. But your idea, especially the conditional ruleset, is for sure thought-provoking.
- Der_Einzige 3y agoIt’s not grandiose at all. It’s rather easy to make LLMs follow constraints - many such examples but I’ll shamelessly self plug: https://paperswithcode.com/paper/most-language-models-can-be-poets-too-an-ai-1 https://paperswithcode.com/paper/most-language-models-can-be...
- warrenm 3y agoSure an LLM could follow a constraint - but there is no guarantee it does And even if it follows a constraint while using it, there is no guarantee it did while it was being trained/populated
- nullc 3y agoHm? No, they just change the sampler so that it can only chose valid tokens.