It might be better if you can spin up separate LLM's for each one, each with its own unique context or even fine tuning (or, at least, start each one's response

It might be better if you can spin up separate LLM's for each one, each with its own unique context or even fine tuning (or, at least, start each one's response with a fresh session using its own individually-tailored prompt and context).