3 ms·
The old version of the creative writing eval had several "in the style of" prompts actually! But I got tired of reading bad Hemingway impersonations so I cut th
by sam-paech 1y ago
The old version of the creative writing eval had several "in the style of" prompts actually! But I got tired of reading bad Hemingway impersonations so I cut them out of the new version.
The creative writing v3 prompts (https://eqbench.com/results/creative-writing-v3 https://eqbench.com/results/creative-writing-v3) focus more on other things that are typical failure modes for LLM writing:
- Romance
- Humour
- Physical-spatial understanding
- Unusual perspectives in first person
- Niche genres
I do have an Asimov and a Le Guin author style prompts in there though. In particular I like the Asimov story as a vibe check.
- ForHackernews 1y agoThat link is a 404 for me
- sam-paech 1y agoOops, should be: https://eqbench.com/creative_writing.html https://eqbench.com/creative_writing.html Sample outputs: https://eqbench.com/results/creative-writing-v3/gemini-2.5-pro-exp-03-25.html https://eqbench.com/results/creative-writing-v3/gemini-2.5-p...