I'm not sure it's possible to fix that "core problem". In the example of an AI assistant managing your emails, users want to be able to give it instructions li

I'm not sure it's possible to fix that "core problem". In the example of an AI assistant managing your emails, users want to be able to give it instructions like "delete that email about flowers" or "move all emails about the new house build to a folder". These control instructions are very context dependant on the data, and the LLM needs both to have any idea what to do about then.