2 ms·
The test provides both the original and the modified excerpt in the user message, so the LLM doesn't need any memorized version of the excerpt to theoretically
by jamessinghal 1y ago
The test provides both the original and the modified excerpt in the user message, so the LLM doesn't need any memorized version of the excerpt to theoretically answer each correctly.
From the paper:
System Prompt
You are helping a student practice memorizing poems. The student will recite a poem, but they may have missed some lines. Your task is to identify exactly which lines are missing from their recitation.
List only the missing lines, nothing else.
User Message
Here is the complete original poem:
{original poem}
Now, here is my recitation which may be missing some lines:
{modified poem}
What lines did I miss? Please list only the missing lines, nothing else.
- scarface_74 1y agoThis worked https://chatgpt.com/share/6855f69d-766c-8010-96e2-ed1b45d3e6f6 https://chatgpt.com/share/6855f69d-766c-8010-96e2-ed1b45d3e6...
- htnwe_2312412 1y agoyes, 69.8% of the time.