LMQL helps a lot with this kind of thing. It makes it really easy to swap prompts and models out, and in general it allows you to maintain your prompt workflows

LMQL helps a lot with this kind of thing. It makes it really easy to swap prompts and models out, and in general it allows you to maintain your prompt workflows in whatever way you maintain the rest of your python code. I’m expecting there will be more examples soon, but you can check out my tree of thoughts implementation below to see what I mean https://github.com/LachlanGray/lmql-tree-of-thoughts https://github.com/LachlanGray/lmql-tree-of-thoughts