You have to teach 3.5 how to respond by including example user/assistant response pairs in your request. Once you do this it pretty reliably follows the structu

You have to teach 3.5 how to respond by including example user/assistant response pairs in your request. Once you do this it pretty reliably follows the structure. I made a vscode extension to help with this https://marketplace.visualstudio.com/items?itemName=jaaxxx.llm-book https://marketplace.visualstudio.com/items?itemName=jaaxxx.l... (mentioned in an earlier ask-hn that seems to have gone missing from the site entirely?) This does bite into your 4096 token limit, unfortunately.