3 ms·
I'd like to humbly suggest that you give her CLIP guided diffusion model a try. It's blowing my mind. https://colab.research.google.com/drive/12a_Wrfi2_gwwAuN
by jcims 5y ago
I'd like to humbly suggest that you give her CLIP guided diffusion model a try. It's blowing my mind.
https://colab.research.google.com/drive/12a_Wrfi2_gwwAuN3VvMTwVMz9TfqctNj#scrollTo=Altu7J5Dfqgv https://colab.research.google.com/drive/12a_Wrfi2_gwwAuN3VvM...
Some recent output (prompts are summarized)
max max alien craft in the desert - https://imgur.com/a/1R5UZQb https://imgur.com/a/1R5UZQb
worshippers gather at mad max alien craft in the desert - https://imgur.com/a/acdbLVu https://imgur.com/a/acdbLVu
vintage 70s alien spacecraft in the meadow - https://imgur.com/a/kwAVWG9 https://imgur.com/a/kwAVWG9
(note these are all upscaled with waifu2x)
My guess is that you've solved this already but I run it in a loop by replacing do_loop() at the bottom of the last frame with the following:
import random
prompt='crystalline alien spacecraft on a flower'
modifiers=['',' macro photography', ' with hyperrealistic 35mm depth of field']
original_prompt = prompt
while True:
for modifier in modifiers:
prompt = original_prompt + modifier
seed = random.randrange(1000)
tqdm.write(f'Prompt {prompt}, Seed {seed}')
do_run()
- Yenrabbit 5y agoHad a play the other day - I love it! But it's quite slow, so for most of my experiments (which involve video and motion) I haven't yet found a way to incorporate it into my workflows without slowing things down considerably. Thanks for sharing though, the work she's doing is so great!
- deleted 5y ago[deleted]
- RiversHaveWings 5y agoI have a 512x512 version now too! https://colab.research.google.com/drive/1QBsaDAZv8np29FPbvjffbE1eytoJcsgA https://colab.research.google.com/drive/1QBsaDAZv8np29FPbvjf...
- jcims 5y agoDang it! I knew this existed but I couldn't find it for some reason. Thank you!!! This has been a wonderful journey...my poor kids have been getting spammed with my latest incantations for the past week lol. I keep trying to think of ways to make this more consumable for the less technically inclined, but GPUs are just not cheap. I was on a V100 for probably 36 hours through Colab via my $9 monthly subscription, that'd run $100 on AWS for the same amount of time on a p3. So then I'd need to figure out a tip jar or something to keep the gas tank full.
- rapido-gato 5y agodumb question, but what is that loop achieving?
- jcims 5y agoNot dumb at all. This code is at the bottom of the notebook cell that actually generates the image. By default it's a one-shot deal, this allows me to continuously generate images with some perturbations in the input to build in some variety (seed value, some prompt 'modifiers' that tend to have a style transfer effect).
- fumblebee 5y agoI'm curious, is there an advantage of doing style transfer implicitly via adding text over explicitly by providing a target image to copy the style from?