4 ms·
> You don't ask the model what instructions to emit. You could still do that, you'd just also need to ask the model for a proof. (But I guess that's much hard
by eru 3y ago
> You don't ask the model what instructions to emit.
You could still do that, you'd just also need to ask the model for a proof. (But I guess that's much harder than heuristically picking which passes to apply.)
- SiempreViernes 3y agoWhat do you do when you check the proof and discover it is false? Just ask again for a proof or discard the emitted instructions?
- eru 3y agoDepends on your use case, I guess?
- hoosieree 3y agoThis is the right way to interact with LLMs in general. Ask for what you want, but independently verify the result. Don't be like that lawyer "...but I asked ChatGPT if it was telling the truth, and it said yes!"
- eru 3y agoWhat you describe is useful, but it's not really what my comment described. My comment was describing the wacky idea of asking the model to come up with a formal, machine-checkable mathematical proof of correctness, too. That's hard in general. The idea in the article of just letting the model pick between different, already proven-correct, optimization passes is much saner most of the time.