A clearer way to make my point might be, the LLM is always aligned to something. If you don't bring that in line with what you want, then it's aligned to noise.

A clearer way to make my point might be, the LLM is always aligned to something. If you don't bring that in line with what you want, then it's aligned to noise. Kind of like if you hired someone to do secretarial work in the same way you might be processing documents with an LLM, if you don't give them instruction about how the work needs to be performed, you shouldn't have a high confidence they'll perform it correctly.