3 ms·

Show HN: Built a "Story Chatbot Arena" to Crowdsource AI Story Preferences

2 points by doc-editor 2y ago

Hi HN, I’m a university student interested in Gen AI, and over the holidays, I built a project in public: Who Rates the Rater? – a crowdsourced dataset for benchmarking AI-generated storytelling. The Idea Inspired by Chatbot Arena, this lets users compare AI-generated stories and provide feedback. The goal is to refine LLMs for creative writing using real human preferences. How It Works - Live Demo: https://storycrowdsourcepreference.streamlit.app https://storycrowdsourcepreference.streamlit.app - Tech Stack: Built with Streamlit + Supabase - Open Source: https://github.com/clchinkc/story_crowdsource_preference https://github.com/clchinkc/story_crowdsource_preference Get Involved - Try it & star the repo if you find it interesting - Bug reports & feature requests welcome on Twitter - Follow me for future AI & storytelling projects Would love to hear your thoughts!

andrewfromx 2y ago
nice I tried it with: The Hero's Journey Steps The Departure (or Separation) The Ordinary World - The hero exists in their normal world before the adventure begins The Call to Adventure - The hero is presented with a challenge or quest Refusal of the Call - Initially, the hero is reluctant to follow the call Meeting the Mentor - The hero encounters a guide who provides advice and tools Crossing the First Threshold - The hero commits to the adventure and enters the special world The Initiation Tests, Allies, and Enemies - The hero faces trials, makes friends, and confronts foes Approach to the Innermost Cave - The hero prepares for the major challenge ahead The Ordeal - The hero faces their greatest fear or challenge, experiencing "death" and "rebirth" Reward (Seizing the Sword) - The hero achieves the goal and gains new power or knowledge The Return The Road Back - The hero begins the journey back to the ordinary world Resurrection - The hero faces a final test where everything is at stake Return with the Elixir - The hero returns with something to improve the ordinary world
- doc-editor 2y ago
  Hi! Did you get good results? Is this dataset worth collecting?
  - andrewfromx 2y ago
    no, i think the prompt was too long. It said "running..." but never showed any results. I think an AI that could spit out a compelling movie that follows the hero's journey like star wars, or the matrix, or The Wizard of Oz, etc. would be really compelling. Like click a button a get a new original 2 hour movie script you could sell to hollywood? Amazing.

2 points by doc-editor 2y ago

andrewfromx 2y ago

nice I tried it with: The Hero's Journey Steps The Departure (or Separation) The Ordinary World - The hero exists in their normal world before the adventure begins The Call to Adventure - The hero is presented with a challenge or quest Refusal of the Call - Initially, the hero is reluctant to follow the call Meeting the Mentor - The hero encounters a guide who provides advice and tools Crossing the First Threshold - The hero commits to the adventure and enters the special world The Initiation Tests, Allies, and Enemies - The hero faces trials, makes friends, and confronts foes Approach to the Innermost Cave - The hero prepares for the major challenge ahead The Ordeal - The hero faces their greatest fear or challenge, experiencing "death" and "rebirth" Reward (Seizing the Sword) - The hero achieves the goal and gains new power or knowledge The Return The Road Back - The hero begins the journey back to the ordinary world Resurrection - The hero faces a final test where everything is at stake Return with the Elixir - The hero returns with something to improve the ordinary world

doc-editor 2y ago
Hi! Did you get good results? Is this dataset worth collecting?
- andrewfromx 2y ago
  no, i think the prompt was too long. It said "running..." but never showed any results. I think an AI that could spit out a compelling movie that follows the hero's journey like star wars, or the matrix, or The Wizard of Oz, etc. would be really compelling. Like click a button a get a new original 2 hour movie script you could sell to hollywood? Amazing.