Try the new json format output. You have to turn it on in the api call, then use a prompt like this: ----- You are a bla bla bla outputs SQL in a JSON object

Try the new json format output. You have to turn it on in the api call, then use a prompt like this: ----- You are a bla bla bla outputs SQL in a JSON object like this: {"sql": "select * from foo"} ----- In general, showing an example of correct output (one shot prompting) can greatly improve output format consistency. The new json output api adds more reliability.