3 ms·
just because it's a non-human artifact doesn't necessarily mean it's boring for instance, people like Minecraft-generated worlds even though no human has craft
by VMG 1y ago
just because it's a non-human artifact doesn't necessarily mean it's boring
for instance, people like Minecraft-generated worlds even though no human has crafted them
- card_zero 1y agoI never played much Minecraft but I assume that's some procedural generation where a human crafted the procedure. (Am I being downvoted for not playing enough Minecraft? I apologise.)
- VMG 1y agosure, but humans have also crafted LLMs
- card_zero 1y agoYes, but then again, completely no. I mean, a procedural generation algorithm for a game world is an artwork tuned to produce results the artist likes, usually with care to allow some cases and exclude others and meet a particular vision. It's not very different from a pre-made world, except using the RNG as one of its building blocks.
- VMG 1y agoSame can be said for prompts. What's the difference from a pleasing underground mine cave labyrinth and some weird Pulp novel plot?
- card_zero 1y agoTrue, so I went and looked for the prompts: https://github.com/EQ-bench/creative-writing-bench/blob/main/data/creative_writing_prompts_v3.json https://github.com/EQ-bench/creative-writing-bench/blob/main... Not clear on how these elaborate prompts relate to the very short prompts in the samples.
- sam-paech 1y agoDifferent benchmark, those are for the short form creative writing leaderboard here: https://eqbench.com/creative_writing.html https://eqbench.com/creative_writing.html
- hhjinks 1y ago>tuned to produce results the artist likes Kinda like RLHF?
- dodslaser 1y agoWell, LLMs aren't just randomly spitting out garbled text either. Humans create and curate the training data, humans design the models, and humans train them.