4 ms·
I really wanted to illustrate long stories with Stable Diffusion! So, hacked together this pipeline: Long text -> GPT-3 suggests illustration ideas -> GPT-3 tr
by manderchar 4y ago
I really wanted to illustrate long stories with Stable Diffusion! So, hacked together this pipeline:
Long text ->
GPT-3 suggests illustration ideas ->
GPT-3 translates from English to "prompt-English" ->
Stable Diffusion outputs images
Open source: https://github.com/sharonzhou/long_stable_diffusion https://github.com/sharonzhou/long_stable_diffusion
Here's a published story, illustrated by this repo, titled "Never Hire a Herd of Goats to Mow your Lawn": https://storiesby.ai/p/never-hire-a-herd-of-goats-to-mow https://storiesby.ai/p/never-hire-a-herd-of-goats-to-mow
That story is AI-written, AI-narrated, AI-illustrated story, which a couple friends and I have been generating.
An earlier story made the top of HackerNews a week ago: https://news.ycombinator.com/item?id=32652673 https://news.ycombinator.com/item?id=32652673. I was too slow to illustrate that earlier week's piece, so it became clear to me that I had to automate myself with this repo... definitely not overengineering the solution.
Anyways, hope you like it or parts of it. Pull requests veryyyy welcome. This was just a weekend project to keep my GPUs company.
Tweet with more stuff, if at all interesting: https://twitter.com/realSharonZhou/status/1567031035732594688 https://twitter.com/realSharonZhou/status/156703103573259468...