With chatgpt, for noncoding things, it has rails to avoid things like copyrighted art, violence, adult topics, etc. For coding LLMs, I suspect they have things

With chatgpt, for noncoding things, it has rails to avoid things like copyrighted art, violence, adult topics, etc. For coding LLMs, I suspect they have things like preferences for certain data structures, avoiding directly returning training data (even if that training data might be the only feasible way to do something), preferences for certain languages and APIs, etc. If you knew what some of those preferences and rails were ahead of time, it'd be easier to design your request and also know why it making some odd or unworkable suggestions.