3 ms·

Awesome work! I love this concept, but I'm a writer who's interested in collaborative generative writing. Do you know of any efforts to create something similar

by j4nt4b 6y ago

Awesome work! I love this concept, but I'm a writer who's interested in collaborative generative writing. Do you know of any efforts to create something similar for writing, such as poetry or micro-fiction? If not, I'm curious if you could point me in the right direction for putting something like that together.

joelS 6y ago
Hey, thanks! I dont know about anything collaborative and for writing. https://aidungeon.io/ https://aidungeon.io/ Maybe collaborative to play. And then there are a lot of writers exploring fine-tuning text models like GPT2 for personal use. https://twitter.com/MagicRealismBot https://twitter.com/MagicRealismBot is one of many examples. https://towardsdatascience.com/how-to-fine-tune-gpt-2-so-you-can-generate-long-form-creative-writing-7a5ae1314a61 https://towardsdatascience.com/how-to-fine-tune-gpt-2-so-you... Maybe you should make it!
- j4nt4b 6y ago
  Thank you!
kleer001 6y ago
If you check out the archives of NaNoGenMo over at github you'll likely find what you're looking for: https://nanogenmo.github.io/ https://nanogenmo.github.io/ Check out the yearly resources.
gwern 6y ago
If you'd like to write poetry or fanfiction, I provide GPT-2-1.5b models for both on https://www.gwern.net/GPT-2 https://www.gwern.net/GPT-2 - I don't provide a slick interface for writing (although Astralite has an upcoming web interface which is very snazzy), but they could be plugged into any such interface.
MattRix 6y ago
Something like https://talktotransformer.com/ https://talktotransformer.com/ ?
Jack000 6y ago
a direct transfer of this concept to text isn't possible because the SotA for text generation is based on transformers, which do not work using latent space sampling. The directly analogous version of stylegan in the nlp world would be vq-vae, but currently it doesn't match transformers in generation quality. There are other ways to do generative writing though, mostly with prompts.

by j4nt4b 6y ago

joelS 6y ago

Hey, thanks! I dont know about anything collaborative and for writing. https://aidungeon.io/ https://aidungeon.io/ Maybe collaborative to play. And then there are a lot of writers exploring fine-tuning text models like GPT2 for personal use. https://twitter.com/MagicRealismBot https://twitter.com/MagicRealismBot is one of many examples. https://towardsdatascience.com/how-to-fine-tune-gpt-2-so-you-can-generate-long-form-creative-writing-7a5ae1314a61 https://towardsdatascience.com/how-to-fine-tune-gpt-2-so-you... Maybe you should make it!

j4nt4b 6y ago
Thank you!

kleer001 6y ago

If you check out the archives of NaNoGenMo over at github you'll likely find what you're looking for: https://nanogenmo.github.io/ https://nanogenmo.github.io/ Check out the yearly resources.

gwern 6y ago

If you'd like to write poetry or fanfiction, I provide GPT-2-1.5b models for both on https://www.gwern.net/GPT-2 https://www.gwern.net/GPT-2 - I don't provide a slick interface for writing (although Astralite has an upcoming web interface which is very snazzy), but they could be plugged into any such interface.

MattRix 6y ago

Something like https://talktotransformer.com/ https://talktotransformer.com/ ?

Jack000 6y ago

a direct transfer of this concept to text isn't possible because the SotA for text generation is based on transformers, which do not work using latent space sampling. The directly analogous version of stylegan in the nlp world would be vq-vae, but currently it doesn't match transformers in generation quality. There are other ways to do generative writing though, mostly with prompts.