4 ms·
The problem is that gpt-3.5 has a tendency to ignore system prompts in the api call, that i've noticed, so it'll ignore the instructions and send back yaml plus
by empath-nirvana 3y ago
The problem is that gpt-3.5 has a tendency to ignore system prompts in the api call, that i've noticed, so it'll ignore the instructions and send back yaml plus a bunch of plain text that the controller can't process
- jakear 3y agoYou have to teach 3.5 how to respond by including example user/assistant response pairs in your request. Once you do this it pretty reliably follows the structure. I made a vscode extension to help with this https://marketplace.visualstudio.com/items?itemName=jaaxxx.llm-book https://marketplace.visualstudio.com/items?itemName=jaaxxx.l... (mentioned in an earlier ask-hn that seems to have gone missing from the site entirely?) This does bite into your 4096 token limit, unfortunately.
- empath-nirvana 3y agoif you look at the code, i did do that, it still fairly reliably ignored it and sent me lengthy explanations with the yaml
- jakear 3y agoAh. I wonder if Kubernetes configurations are so frequently accompanied with lengthy explanation text that it is unable to separate the two concepts.