4 ms·

Disco Diffusion was a (bad) thing in 2021 that lead to the spaghetti video / weird Burger Kind Ads level quality. But it ran on consumer GPUs / in Jupyter noteb

Disco Diffusion was a (bad) thing in 2021 that lead to the spaghetti video / weird Burger Kind Ads level quality. But it ran on consumer GPUs / in Jupyter notebook. 2 years ago we had decent video generation for clips 7 months ago we have Sora https://news.ycombinator.com/item?id=39393252 https://news.ycombinator.com/item?id=39393252 (still silence since then) With these things, like DALL-E 1 and GPT-3, the original release of the game changer often comes ca. 2 years before people can actually use it. I think that's what we're looking at. I.e. it's not as fast as you think.

bbor 2y ago
What video generation was decent 2 years ago? Will smith eating spaghetti was barely coherent and clearly broken, and that was March 2023 (https://knowyourmeme.com/memes/ai-will-smith-eating-spaghetti https://knowyourmeme.com/memes/ai-will-smith-eating-spaghett...). And isn’t this model open source…? So we get access to it, like, momentarily? Or did I miss something?
- authorfly 2y ago
  So you're right to be excited, I agree. And I don't know, Meta, like OpenAI, seems to release conditionally, though yes, more. I doubt it before the election. When the Will Smith one was released, it was kind of a parody though. Tech had already been able to produce that level of "quality" for about 2 years at the time of it's publishing. The Will Smith one is honestly something you could have created with Disco Diffusion in early 2021, I used to do this back then... 2022 saw: https://makeavideo.studio/ https://makeavideo.studio/ (coherent, but low res - it was possible to upscale at extreme expense) https://sites.research.google/phenaki/ https://sites.research.google/phenaki/ https://lumiere-video.github.io/ https://lumiere-video.github.io/ It was more like 18-20 months ago sorry so early 2023, but https://runwayml.com/research/gen-1 https://runwayml.com/research/gen-1 was getting there as was https://pika.art/home https://pika.art/home - Sora obviously changed the game, but I would say these two were great.

bbor 2y ago

What video generation was decent 2 years ago? Will smith eating spaghetti was barely coherent and clearly broken, and that was March 2023 (https://knowyourmeme.com/memes/ai-will-smith-eating-spaghetti https://knowyourmeme.com/memes/ai-will-smith-eating-spaghett...). And isn’t this model open source…? So we get access to it, like, momentarily? Or did I miss something?

authorfly 2y ago
So you're right to be excited, I agree. And I don't know, Meta, like OpenAI, seems to release conditionally, though yes, more. I doubt it before the election. When the Will Smith one was released, it was kind of a parody though. Tech had already been able to produce that level of "quality" for about 2 years at the time of it's publishing. The Will Smith one is honestly something you could have created with Disco Diffusion in early 2021, I used to do this back then... 2022 saw: https://makeavideo.studio/ https://makeavideo.studio/ (coherent, but low res - it was possible to upscale at extreme expense) https://sites.research.google/phenaki/ https://sites.research.google/phenaki/ https://lumiere-video.github.io/ https://lumiere-video.github.io/ It was more like 18-20 months ago sorry so early 2023, but https://runwayml.com/research/gen-1 https://runwayml.com/research/gen-1 was getting there as was https://pika.art/home https://pika.art/home - Sora obviously changed the game, but I would say these two were great.