If you want standard responses then presumably LLMs will start to converge on those responses. But if you want a non-standard response then you have to ask for

If you want standard responses then presumably LLMs will start to converge on those responses. But if you want a non-standard response then you have to ask for it, and I think that will continue to be a kind of "prompt engineering". For instance I'm working in math problem generation right now and you could imagine saying "make the problem harder" and you'll get back... something. But what does "harder" really mean? It's very underspecified. If you work in making educational material you probably have some much clearer criteria, and if you are building a product you may have a clear point of view about what you want in the next problem in a sequence... and "harder" is just punting on all these details. The tricks may stop being as necessary, but the deciding what you want and how to explain what you want seems essential no matter how smart the LLM is.