> Curious as to why some sort of model specifically trained for prompt engineering couldn't be placed before a LLM in a pipeline, or used in a transfer learning

> Curious as to why some sort of model specifically trained for prompt engineering couldn't be placed before a LLM in a pipeline, or used in a transfer learning scenario. They can. It's just important enough for performance to be worth doing this manually. > I'm also curious as to why existing LLMs can't be fine tuned to handle this, if prompt engineering is really a major concern. It depends what you want them to do. They're general purpose things and there isn't a one size fits all solution here.