15 ms·
> Stable Diffusion is still the go-to solution. I strongly suspect the same thing with Sora. Sure, for people who want detailed control with AI-generated video
by dragonwriter 3y ago
> Stable Diffusion is still the go-to solution. I strongly suspect the same thing with Sora.
Sure, for people who want detailed control with AI-generated video, workflows built around SD + AnimateDiff, Stable Video Diffusion, MotionDiff, etc., are still going to beat Sora for the immediate future, and OpenAI's approach structurally isn't as friendly to developing a broad ecosystem adding power on top of the base models.
OTOH, the basic simple prompt-to-video capacity of Sora now is good enough for some uses, and where detailed control is not essential that space is going to keep expanding -- one question is how much their plans for safety checking (which they state will apply both to the prompt and every frame of output) will cripple this versus alternatives, and how much the regulatory environment will or won't make it possible to compete with that.
- theLiminator 3y agoI suspect given equal effort into prompting both, Sora probably provides superior results.
- dragonwriter 3y ago> I suspect given equal effort into prompting both, Sora probably provides superior results Strictly to prompting, probably, just as that is the case with Dall-E 3 vs, say, SDXL. The thing is, there’s a lot more that you can do than just tweaking prompting with open models, compared to hosted models that offer limited interaction options.
- karmasimida 3y agoGenerate stock video bits I think.