3 ms·
That’s what it does unprompted. Prompt engineering involves (among other things) anticipating this and encouraging the model to ask clarifying questions before
by cadamsdotcom 1y ago
That’s what it does unprompted.
Prompt engineering involves (among other things) anticipating this and encouraging the model to ask clarifying questions before it begins.
Separately but related, models are getting better at recognizing and expressing their own uncertainty; but again they won’t do that automatically; you need to ask for that behavior in your prompt.
And finally; models aren’t yet where they should be with regard to stopping to ask questions. A lot of the Devin style agentic products are going to push & eval their models for their ability to do this, so it’s a capability you can reasonably expect to see from future models and will make a lot of my post obsolete.
So right now you need to ask the model to ask you clarifying questions and tell you what it’s uncertain of - before it goes off and does work for you.