3 ms·
There are a few available to the public. runway.ai and kling are a couple that I see heavily used on Twitter. I pay for runway right now for experiments and it
by zoogeny 2y ago
There are a few available to the public. runway.ai and kling are a couple that I see heavily used on Twitter.
I pay for runway right now for experiments and it works. The problem is that maybe 1 out of 10 prompts result in something useable. And when I say useable I have pretty low standards. Since the model pumps out 5 or 10 second clips you have to be pretty creative since the models still struggle with keeping any kind of consistency between shots. Things like lighting, locations, characters can all morph within/between cips.
The issue isn't quality exactly, it is like 80% there. When it works, it is capable of blowing your mind. You can get something that looks like it is a bonafide Hollywood shot. But that is a single 5 second or 10 second clip. So far there is no easy way to reliably piece those together to make even a 1 minute long TikTok.
The real problem is the cost. Since you have to sometimes do 10 prompts to get a single acceptable shot it is like a 10x multiplier on the cost per second of video. That can get very expensive for even short experiments.
- hackernewds 2y agoHow much do you pay? Imagine if they could charge premium prices to studio's like $100k/user that's probably where the quality is, but not the billions
- yurylifshits 2y agoHi zoogeny (and anyone else here) — you can try our new app Nim to address the Runway problems you describe https://alpha.nim.video https://alpha.nim.video We offer both image-to-video (same situation as Runway, need a few attempts to make something awesome) and video-to-video (under the name "Restyle 2.0") - this is our newest tool and is highly reliable, i.e. you can get complex motion (kissing, handshakes, boxing, skateboarding, etc) with controllable changes to input video (changing outfits, characters, backgrounds, styles). Unlike Runway and Kling, we currently offer a smiple UNLIMITED plan for just $10/mo. Check it out! https://alpha.nim.video https://alpha.nim.video
- j0ej0ej0e 2y agoWhat's the maximum video dimensions your service can output? with a 1024x1024 image it exports 512x512 on the free plan.
- zoogeny 2y agoThanks - will look into this more deeply once I am ready to start integrating generation into my tool. Do you have an API that can be called? Are you interested in reselling your technology through 3rd party tools?
- dvngnt_ 2y agoGTA IV Real Life - Runway Gen 3 AI shows the potential to turn low-fidelity source to something life-like https://youtu.be/FGBSzSO8k6A https://youtu.be/FGBSzSO8k6A it would be really cool to this to work locally at playable rates
- jonplackett 2y agoKling’s new one 1.5 model is WAY better than anything else I’ve tried. Makes runway look terrible. Really good temporal consistency and even gets hair and clothes and stuff right. They also just added the ability to do lip sync to a moving head and it gets the lighting right too - runways lip sync breaks if there’s any movement at all. I’m gonna stop pumping Kling on this comment thread now - until they start paying me to advertise!