4 ms·

> (you can use gpt-3.5 if you don't have access to gpt-4, but the results aren't as reliable How reliable are the results GPT-4 vs GPT-3.5?

• empath-nirvana 4y ago
  The problem is that gpt-3.5 has a tendency to ignore system prompts in the api call, that i've noticed, so it'll ignore the instructions and send back yaml plus a bunch of plain text that the controller can't process
  • jakear 4y ago
    You have to teach 3.5 how to respond by including example user/assistant response pairs in your request. Once you do this it pretty reliably follows the structure. I made a vscode extension to help with this https://marketplace.visualstudio.com/items?itemName=jaaxxx.llm-book https://marketplace.visualstudio.com/items?itemName=jaaxxx.l... (mentioned in an earlier ask-hn that seems to have gone missing from the site entirely?) This does bite into your 4096 token limit, unfortunately.
    • empath-nirvana 4y ago
      if you look at the code, i did do that, it still fairly reliably ignored it and sent me lengthy explanations with the yaml
      • jakear 4y ago
        Ah. I wonder if Kubernetes configurations are so frequently accompanied with lengthy explanation text that it is unable to separate the two concepts.