3 ms·
Why is the main character named Rhys in most (?) of them? Llama[1], Claude[3], Mistral[4] & DeepSeek-r1[5] samples all named the main character Rhys, even thou
by polynomial 2y ago
Why is the main character named Rhys in most (?) of them? Llama[1], Claude[3], Mistral[4] & DeepSeek-r1[5] samples all named the main character Rhys, even though that was no where specified in the prompt? GPT-4o gives the character a different name[6]. Gemini[2] names the bookshop person Rhys instead! Am I just missing something really obvious? I feel like I'm missing something big that's right in front of me
[1] https://eqbench.com/results/creative-writing-v2/meta-llama__Llama-3-70b-chat-hf.txt https://eqbench.com/results/creative-writing-v2/meta-llama__...
[2] https://eqbench.com/results/creative-writing-v2/gemini-1.5-flash-001.txt https://eqbench.com/results/creative-writing-v2/gemini-1.5-f...
[3] https://eqbench.com/results/creative-writing-v2/claude-3-opus-20240229.txt https://eqbench.com/results/creative-writing-v2/claude-3-opu...
[4] https://eqbench.com/results/creative-writing-v2/mistralai__Mistral-Large-Instruct-2407.txt https://eqbench.com/results/creative-writing-v2/mistralai__M...
[5] https://eqbench.com/results/creative-writing-v2/deepseek-ai__DeepSeek-R1.txt https://eqbench.com/results/creative-writing-v2/deepseek-ai_...
[6] https://eqbench.com/results/creative-writing-v2/gpt-4o-2024-11-20.txt https://eqbench.com/results/creative-writing-v2/gpt-4o-2024-...