The job of the system is to be useful, not to be AI. Long prompts are very useful for getting good performance and establishing a baseline for behaviour, which

The job of the system is to be useful, not to be AI. Long prompts are very useful for getting good performance and establishing a baseline for behaviour, which the model can then continue. Furthermore, you can see this as exploiting an aspect of these models that make them uniquely flexible: in context learning.