4 ms·
I've noticed people will routinely prompt for a specific style when generating visual art, but not when generating text. Wouldn't it be better for consistency t
by boredhedgehog 2y ago
I've noticed people will routinely prompt for a specific style when generating visual art, but not when generating text. Wouldn't it be better for consistency to add something like "in the style of Hemingway" to an experiment like this?
- sam-paech 2y agoThe old version of the creative writing eval had several "in the style of" prompts actually! But I got tired of reading bad Hemingway impersonations so I cut them out of the new version. The creative writing v3 prompts (https://eqbench.com/results/creative-writing-v3 https://eqbench.com/results/creative-writing-v3) focus more on other things that are typical failure modes for LLM writing: - Romance - Humour - Physical-spatial understanding - Unusual perspectives in first person - Niche genres I do have an Asimov and a Le Guin author style prompts in there though. In particular I like the Asimov story as a vibe check.
- ForHackernews 2y agoThat link is a 404 for me
- sam-paech 2y agoOops, should be: https://eqbench.com/creative_writing.html https://eqbench.com/creative_writing.html Sample outputs: https://eqbench.com/results/creative-writing-v3/gemini-2.5-pro-exp-03-25.html https://eqbench.com/results/creative-writing-v3/gemini-2.5-p...