4 ms·

Smart for Dalle, Midjourney, and Stable Diffusion to capitalize on this quickly. It looks like the technology is being commoditized at rapid speed. I wonder wha

Smart for Dalle, Midjourney, and Stable Diffusion to capitalize on this quickly. It looks like the technology is being commoditized at rapid speed. I wonder what’s next.

culi 4y ago
People are getting into "prompt-craft". People have also started pasting different AI tools together like putting these images into CogVideo[0] to generate actual videos (takes ages and usually the length of a gif currently). Others have realized you can run these images through GANs to make faces look extremely convincing I think "what's next" is fitting these tools together in a larger system [0] https://replicate.com/nightmareai/cogvideo https://replicate.com/nightmareai/cogvideo
- bottlepalm 4y ago
  Ok I’m just going to list ideas, feel free to add more * Text to 3d model * Text to video clip * Illustrations for newspapers * Generating pictures for food menus * Generating a music video from a song * Generating pictures or even an entire movie for a book * Interior design ideas * Product design ideas I have noticed that leveraging these tools isn’t easy. It requires a fair bit of creativity to come up with the prompts to create an image to really wow somebody.
  - culi 4y ago
    Someone on the midjourney discord is making a comic with images generated by the bot. Another person is making a Magic The Gathering card pack with generated art (it looks good too!). People are already using it for stock photos One murky area we're still far away from but I'm curious to follow the developments on: AI-generated movies. Once generated clips gets good, what if some movie buff can just generate a movie, scene-by-scene, just using these tools? What about "casting" certain celebrities? The comic I mentioned uses Zendaya (probably because she plays a character in the Dune movies) as a character
    - bottlepalm 4y ago
      Lot of potential for movies- using AI to up res, AI to turn a 2d movie 3d, more advanced would be new or edited scenes. Or how about translating a live action movie to a cartoon and vice versa. Or a different style or tone. Run The Lord of the Rings through a cyberpunk filter.
      - ChickeNES 4y ago
        I'm eager for someone to start recreating the missing episodes of Doctor Who. The audio still exists and there are publicity shots from many of the missing episodes
        nineteen999 4y ago
        I wonder how good AI will be at recreating the look of the props made out of broom sticks, gaffer tape and paper mache.
    - kyriakos 4y ago
      How do they get consistent looks? I mean if you are using it for a comic book your characters should look the same throughout the story. From my experience, the results between prompts are completely different even with minor variations.
      - goldenkey 4y ago
        If the seed remains the same, the difference between similar prompts is actually continuous. Here's a slew of images (1 through 5) I generated all from the same seed and same prompt sans a word or two: https://www.instagram.com/p/Chg60Fou6xB/ https://www.instagram.com/p/Chg60Fou6xB/
        kyriakos 4y ago
        Thanks. Those are amazing by the way
  - soperj 4y ago
    > Generating pictures for food menus This is what I've been doing for any recipes[0] that don't have pictures with pretty good result. [0] www.reciped.io ex: https://www.reciped.io/recipes/mushroom-and-onion-pizza/ https://www.reciped.io/recipes/mushroom-and-onion-pizza/
- ChickeNES 4y ago
  Is there a good central source that lists out all of the currently available tools?
deleted 4y ago
[deleted]
glcheetham 4y ago
The AI is moving up the "content ladder" generating text -> now images -> next videos Smart for Google to invest in this because their business relies on third party content to exist (blogs, webpages, youtube videos) If they can vertically integrate their business to create the content AND own the discovery algorithms then they officially win the internet
- astrange 4y ago
  Generating videos and 3D models is _much_ more difficult than images. You can’t just train off videos from the internet in the same way, because they don’t have sufficient text labels to understand them like CLIP does.
  - namose 4y ago
    I wonder if subtitles could be used, so rather than describing the video, you just write a script and it generates video for you. I'm certainly no expert, but it does seem like there's a lot more data there.
  - blueblisters 4y ago
    Oh but they have sound which can be annotated much faster/more efficiently. You also potentially have screenplay but the amount of training data is probably too less and sparse. FWIW, I don’t think the AI systems will generate a whole video by itself - it’ll be some form of image to image generation where an artist will render a rough sketch of the scene and the AI will fill in the details, frame by frame.
    - bottlepalm 4y ago
      I mean at this point it’s really not a question of if, but when - right?
spyder 4y ago
Stability.ai and probably others too already working on video and audio models too and also I think I heard a service to train / finetune the model with your own dataset.

Smart for Dalle, Midjourney, and Stable Diffusion to capitalize on this quickly. It looks like the technology is being commoditized at rapid speed. I wonder what’s next.

culi 4y ago

People are getting into "prompt-craft". People have also started pasting different AI tools together like putting these images into CogVideo[0] to generate actual videos (takes ages and usually the length of a gif currently). Others have realized you can run these images through GANs to make faces look extremely convincing I think "what's next" is fitting these tools together in a larger system [0] https://replicate.com/nightmareai/cogvideo https://replicate.com/nightmareai/cogvideo

bottlepalm 4y ago
Ok I’m just going to list ideas, feel free to add more * Text to 3d model * Text to video clip * Illustrations for newspapers * Generating pictures for food menus * Generating a music video from a song * Generating pictures or even an entire movie for a book * Interior design ideas * Product design ideas I have noticed that leveraging these tools isn’t easy. It requires a fair bit of creativity to come up with the prompts to create an image to really wow somebody.
- culi 4y ago
  Someone on the midjourney discord is making a comic with images generated by the bot. Another person is making a Magic The Gathering card pack with generated art (it looks good too!). People are already using it for stock photos One murky area we're still far away from but I'm curious to follow the developments on: AI-generated movies. Once generated clips gets good, what if some movie buff can just generate a movie, scene-by-scene, just using these tools? What about "casting" certain celebrities? The comic I mentioned uses Zendaya (probably because she plays a character in the Dune movies) as a character
  - bottlepalm 4y ago
    Lot of potential for movies- using AI to up res, AI to turn a 2d movie 3d, more advanced would be new or edited scenes. Or how about translating a live action movie to a cartoon and vice versa. Or a different style or tone. Run The Lord of the Rings through a cyberpunk filter.
    - ChickeNES 4y ago
      I'm eager for someone to start recreating the missing episodes of Doctor Who. The audio still exists and there are publicity shots from many of the missing episodes
      - nineteen999 4y ago
        I wonder how good AI will be at recreating the look of the props made out of broom sticks, gaffer tape and paper mache.
  - kyriakos 4y ago
    How do they get consistent looks? I mean if you are using it for a comic book your characters should look the same throughout the story. From my experience, the results between prompts are completely different even with minor variations.
    - goldenkey 4y ago
      If the seed remains the same, the difference between similar prompts is actually continuous. Here's a slew of images (1 through 5) I generated all from the same seed and same prompt sans a word or two: https://www.instagram.com/p/Chg60Fou6xB/ https://www.instagram.com/p/Chg60Fou6xB/
      - kyriakos 4y ago
        Thanks. Those are amazing by the way
- soperj 4y ago
  > Generating pictures for food menus This is what I've been doing for any recipes[0] that don't have pictures with pretty good result. [0] www.reciped.io ex: https://www.reciped.io/recipes/mushroom-and-onion-pizza/ https://www.reciped.io/recipes/mushroom-and-onion-pizza/
ChickeNES 4y ago
Is there a good central source that lists out all of the currently available tools?

deleted 4y ago

[deleted]

glcheetham 4y ago

The AI is moving up the "content ladder" generating text -> now images -> next videos Smart for Google to invest in this because their business relies on third party content to exist (blogs, webpages, youtube videos) If they can vertically integrate their business to create the content AND own the discovery algorithms then they officially win the internet

astrange 4y ago
Generating videos and 3D models is _much_ more difficult than images. You can’t just train off videos from the internet in the same way, because they don’t have sufficient text labels to understand them like CLIP does.
- namose 4y ago
  I wonder if subtitles could be used, so rather than describing the video, you just write a script and it generates video for you. I'm certainly no expert, but it does seem like there's a lot more data there.
- blueblisters 4y ago
  Oh but they have sound which can be annotated much faster/more efficiently. You also potentially have screenplay but the amount of training data is probably too less and sparse. FWIW, I don’t think the AI systems will generate a whole video by itself - it’ll be some form of image to image generation where an artist will render a rough sketch of the scene and the AI will fill in the details, frame by frame.
  - bottlepalm 4y ago
    I mean at this point it’s really not a question of if, but when - right?

spyder 4y ago

Stability.ai and probably others too already working on video and audio models too and also I think I heard a service to train / finetune the model with your own dataset.