4 ms·
What I found is that works, but is very expensive: - Do chain prompting where each character gets a separate prompt for the dialogue. Here you'll give it all t
by Foreignborn 3y ago
What I found is that works, but is very expensive:
- Do chain prompting where each character gets a separate prompt for the dialogue. Here you'll give it all the character info needed to figure out what the character would do (emotions, background, the story context) and then have GPT4 take passes at what this character would think/do/say.
- Optionally, you can use some sort of reACT or chain of thought prompting to proof-read/critique the answer to minimize noise. I haven't fully explored this, but I think this agent needs to know the entire story outline/context.
- After you get this, you can use an instruction-tuned agent like text-davinci or text-davinci-edit to actually write the prose. It works really well with few-shot examples. It's much better at creative writing. I'm sad they consider it legacy because to me it's the _only_ way to get usable creative writing.
- Now run the rest of the story. You may need to keep some sort of state about the character so that it informs the next character interaction, but I haven't gotten that far in my research.
- cl42 3y agoYou raise a good point: while ChatGPT might have stylistic limitations that make it less-than-ideal for a "Primer"-type product, LLMs more broadly don't suffer from that stylistic limitation. Whether it's via prompting, fine-tuning, or something else, you can build multiple characters who address some of the original commenter's concerns.
- fennecfoxy 3y agoYeah, this is a great approach. I've managed to get gpt3.5 to play 4 characters at the same time, but it's very easy for characters to leak into each other/become muddled. Especially since gpt has no specific training on certain things like spatial aspects of a narrative (ie who has an object or where it's located). To be fair the most optimal would be taking something like llama2 and generating a lora for each character such that you've fine tuned the model along with additional context for the character. I can forgive the big ball of "do everything" weights for not having a specific personality.