4 ms·
I'm super glad that Anthropic has put this up -- having a set of examples is super critical for folks who are writing prompts. (In fact my collaborators and I w
by zamfi 2y ago
I'm super glad that Anthropic has put this up -- having a set of examples is super critical for folks who are writing prompts. (In fact my collaborators and I wrote a paper about these challenges last year [1].)
But I also wish they had included more than one example input/output pair for each prompt type: people really pattern match hard on single examples for prompts, and don't get a good sense for what's critical and what's optional in any given prompt or input from just one example. It wouldn't be that much work to have a carousel of input/output pairs here that readers could flip through, and I suspect it would make this page 10X more useful.
If anyone from Anthropic is reading here, I can't emphasize this enough! It's not just about "well, users should experiment" because often users don't know what they can effectively experiment with in these prompts, because it's hard to extrapolate from just one working example. Multiple examples (even just 2-3!) will give readers much more background here!
[1] https://dl.acm.org/doi/pdf/10.1145/3544548.3581388 https://dl.acm.org/doi/pdf/10.1145/3544548.3581388 (open access link)