5 ms·

Runway Gen-4

79 points by meetpateltech 2y ago

vunderba 2y ago
Lots of quick cuts on the longer movies. Good quality but I can't find any details on perhaps one of the most important questions, which is what's the maximum duration for either T2V or I2V? I have yet to see any decent cohesive generators beyond roughly 10 seconds.
genevra 2y ago
I'm shortening my time-line to 10 years before we can watch fully generated in real time movies about our preferred prompt.
- m463 2y ago
  Totally custom movies would be pretty fun. "I go back in time to high school but Know Stuff" or "my wife apologizing"
xnx 2y ago
Runway is pretty far down on this leaderboard (Google Veo 2 is on top): https://huggingface.co/spaces/ArtificialAnalysis/Video-Generation-Arena-Leaderboard https://huggingface.co/spaces/ArtificialAnalysis/Video-Gener... Hopefully Gen-4 can improve.
- echelon 2y ago
  Check out the quite busy /r/aivideo community [1] for a pulse on the technology. The vast majority of what gets upvoted incorporates Kling. It's a really good video model. They've dominated since October or so. [1] https://www.reddit.com/r/aivideo https://www.reddit.com/r/aivideo
  - xnx 2y ago
    Is it dominant because it is the best with a free tier?
- jejeyyy77 2y ago
  what are these leaderboards even measuring
  - leumon 2y ago
    elo ranking based on user preferences. you can vote on prompts and submit new ones in the 'video arena' tab
vessenes 2y ago
So, these demos look outstanding, far better than Wan-2.1 which is the current open weights leader in the video generation community. I’m particularly interested in their claim that they’re improving on real world physics and understanding, sort of a JEPA-reminiscent claim. Nothing about their model, training, infra in the announcement. I’ve never used Runway, but their pitch and partners (Lionsgate, for instance) tell me they’re working on making a tool for industry pros —- this already looks to me like it will be useful if it integrates well with existing tools. One of the most interesting shots they showed was an infill based on sketch; they had an image of a misty farm area, and a sketch of a farmhouse, they showed the farmhouse rendered in, then the same house on fire, then what looked like maybe a color grading step. I’m curious to play with this and see how good it is. *UPDATE* I just paid for a monthly standard subscription to try it out, and .. couldn’t figure out how to get access to it at all. I can say that Runway 3 ML Turbo gives real nightmare fuel on cel-shaded source images in I2V use cases though. Waiting to see if I get my refund or access.
- bastawhiz 2y ago
  Hey vessenes, Gen-4 is still being rolled out. Stay tuned.
  - vessenes 2y ago
    Hey Basta, cool. You should note that in your payment page which says if people pay they get access.
- whywhywhywhy 2y ago
  > improving on real world physics and understanding Can't help but flashback to when Sora was first previewed and the hype crew were claiming it was a world physics engine and now when it finally shipped months and months later no one uses it and it didn't deliver on any of the hype at all.
  - deleted 2y ago
    [deleted]
  - 2y ago
accrual 2y ago
Pretty impressive. I watched "The Retrieval". It gave me slight Scavengers Reign vibes, maybe inspired by it. There are still some minor/subtle artifacts that give it away as an AI generation, but still totally watchable and enjoyable. I suspect we'll see some fully AI generated feature length films in the future. There will be all sorts of discourse about it, but IMO at the end of the day, it's just another tool for expression.
torginus 2y ago
This looks really pretty and the website hints at professional use, but I'd like to ask anyone who works in the media industry - is this model good enough, or convenient enough to fit into the production pipeline of professional video editors or will this be another novelty model used to generate memes and stuff?
- echelon 2y ago
  Industry chose another video gen company, one which has been super busy making deals with the top studios. edit: I removed the name of the company, but their folks are definitely in this forum.
  - postsantum 2y ago
    Why? Do share, please
    - echelon 2y ago
      It may or may not be a YC company. They have a really good video model.
      - KuriousCat 2y ago
        Is that Stability?

79 points by meetpateltech 2y ago

Lots of quick cuts on the longer movies. Good quality but I can't find any details on perhaps one of the most important questions, which is what's the maximum duration for either T2V or I2V? I have yet to see any decent cohesive generators beyond roughly 10 seconds.

genevra 2y ago

I'm shortening my time-line to 10 years before we can watch fully generated in real time movies about our preferred prompt.

m463 2y ago
Totally custom movies would be pretty fun. "I go back in time to high school but Know Stuff" or "my wife apologizing"

xnx 2y ago

Runway is pretty far down on this leaderboard (Google Veo 2 is on top): https://huggingface.co/spaces/ArtificialAnalysis/Video-Generation-Arena-Leaderboard https://huggingface.co/spaces/ArtificialAnalysis/Video-Gener... Hopefully Gen-4 can improve.

echelon 2y ago
Check out the quite busy /r/aivideo community [1] for a pulse on the technology. The vast majority of what gets upvoted incorporates Kling. It's a really good video model. They've dominated since October or so. [1] https://www.reddit.com/r/aivideo https://www.reddit.com/r/aivideo
- xnx 2y ago
  Is it dominant because it is the best with a free tier?
jejeyyy77 2y ago
what are these leaderboards even measuring
- leumon 2y ago
  elo ranking based on user preferences. you can vote on prompts and submit new ones in the 'video arena' tab

vessenes 2y ago

So, these demos look outstanding, far better than Wan-2.1 which is the current open weights leader in the video generation community. I’m particularly interested in their claim that they’re improving on real world physics and understanding, sort of a JEPA-reminiscent claim. Nothing about their model, training, infra in the announcement. I’ve never used Runway, but their pitch and partners (Lionsgate, for instance) tell me they’re working on making a tool for industry pros —- this already looks to me like it will be useful if it integrates well with existing tools. One of the most interesting shots they showed was an infill based on sketch; they had an image of a misty farm area, and a sketch of a farmhouse, they showed the farmhouse rendered in, then the same house on fire, then what looked like maybe a color grading step. I’m curious to play with this and see how good it is. *UPDATE* I just paid for a monthly standard subscription to try it out, and .. couldn’t figure out how to get access to it at all. I can say that Runway 3 ML Turbo gives real nightmare fuel on cel-shaded source images in I2V use cases though. Waiting to see if I get my refund or access.

bastawhiz 2y ago
Hey vessenes, Gen-4 is still being rolled out. Stay tuned.
- vessenes 2y ago
  Hey Basta, cool. You should note that in your payment page which says if people pay they get access.
whywhywhywhy 2y ago
> improving on real world physics and understanding Can't help but flashback to when Sora was first previewed and the hype crew were claiming it was a world physics engine and now when it finally shipped months and months later no one uses it and it didn't deliver on any of the hype at all.
- deleted 2y ago
  [deleted]
- 2y ago

accrual 2y ago

Pretty impressive. I watched "The Retrieval". It gave me slight Scavengers Reign vibes, maybe inspired by it. There are still some minor/subtle artifacts that give it away as an AI generation, but still totally watchable and enjoyable. I suspect we'll see some fully AI generated feature length films in the future. There will be all sorts of discourse about it, but IMO at the end of the day, it's just another tool for expression.

torginus 2y ago

This looks really pretty and the website hints at professional use, but I'd like to ask anyone who works in the media industry - is this model good enough, or convenient enough to fit into the production pipeline of professional video editors or will this be another novelty model used to generate memes and stuff?

echelon 2y ago
Industry chose another video gen company, one which has been super busy making deals with the top studios. edit: I removed the name of the company, but their folks are definitely in this forum.
- postsantum 2y ago
  Why? Do share, please
  - echelon 2y ago
    It may or may not be a YC company. They have a really good video model.
    - KuriousCat 2y ago
      Is that Stability?