You could try generating many Q&A examples from a LLM with the desired prompt, then finetuning that model using those examples, but leaving out the prompt. If t

You could try generating many Q&A examples from a LLM with the desired prompt, then finetuning that model using those examples, but leaving out the prompt. If the prompt is very long and contains lots of information, you may even try to use a LLM to generate the Qs.