2 ms·

There are examples of really long, multi-step prompts in that series of articles. Is GPT-4 good at following those in practice?

• dartos 3y ago
  From what I’ve seen, yes generally. You need to tinker the prompt to get it to follow the instructions all the time, but usually it’s pretty good about it. Take a look at chain-of-thought prompting or the reAct paper for some research into it.
• rmbyrro 3y ago
  It depends on the total context of the conversation. As the number of tokens grow, it starts to lose track. Usually it's noticeable and you can remind it of what it's missing.
• nomel 3y ago
  From my experience, these types of prompts are only good for three or four responses/follow ups, then it somewhat quickly "degrades" to more standard behavior, forgetting the detailed instructions.
  • fudged71 3y ago
    I think it's possible in a prompt for the LLM to remind itself of it's purpose in its own responses, creating a sort of flywheel effect. If you use a longer context window model (16k, 32k, 100k) this shouldn't be as much of a problem.