Sure an LLM could follow a constraint - but there is no guarantee it does And even if it follows a constraint while using it, there is no guarantee it did whil

Sure an LLM could follow a constraint - but there is no guarantee it does And even if it follows a constraint while using it, there is no guarantee it did while it was being trained/populated