31 ms·

Imagen Video: high definition video generation with diffusion models

800 points by jasondavies 4y ago

joshcryer 4y ago
Pre-singularity is really cool. Whole world generation in what, 5 years?
alphabetting 4y ago
We're about a week into text-to-video models and they're already this impressive. Insane to imagine what the future holds in this space.
- J5892 4y ago
  Insane, terrifying, incredible, etc. We're rapidly stumbling into the future of media. Who would've imagined a year ago that trivial AI image generation would not only be this advanced, but also this pervasive in the mainstream. And now video is already this good. We'll have full audio/video clips within a month.
  - joshcryer 4y ago
    Audio is the next thing that Stability AI is dropping, then video. In a few months you'll be able to conjure up anything you want if you have a few GPU cores. Pretty incredible.
    - astrange 4y ago
      I won’t be impressed until it can generate smells.
      - croddin 4y ago
        You joke, but that is in the works as well (would require special hardware though) https://ai.googleblog.com/2022/09/digitizing-smell-using-molecular-maps.html https://ai.googleblog.com/2022/09/digitizing-smell-using-mol...
        astrange 4y ago
        Oh, it wasn’t really a joke. Didn’t know they were working on it though - I’ve always thought wanted to see use of all the senses in UIs, especially VR. Plus then maybe we could get a computer to tell us what thioacetone smells like without actually having to experience it.
- trention 4y ago
  >We're about a week into text-to-video models It's at the very least 5 years old: https://arxiv.org/abs/1710.00421 https://arxiv.org/abs/1710.00421
  - amilios 4y ago
    There's a significant quality difference however if you look at the generated samples in the paper. Imagen Video is leagues ahead. The progress is still quite drastic
- kertoip_1 4y ago
  How is it possible that all of them just started to appear at the same time? Is it possible that those models were designed and trained in a last few weeks? Has some "magic key" to content generation been just unexpectedly discovered? Or the topic became trendy and everyone is just publishing what they've got so far, so they hope to benefit from media attention?
  - schleck8 4y ago
    This is why https://www.reddit.com/r/singularity/comments/xwdzr5/the_number_of_ai_papers_on_arxiv_per_month_grows/ https://www.reddit.com/r/singularity/comments/xwdzr5/the_num...
    - filoleg 4y ago
      As pointed out in the comments of that thread, if you make the same graph of all papers on arXiv by year (instead of just AI+ML), it would look roughly the same. Which speaks more about the growth of popularity of arXiv or the total number publications, rather than AI+ML specifically.
  - thomasahle 4y ago
    > the topic became trendy and everyone is just publishing what they've got so far, so they hope to benefit from media attention? Presumably people are scrambling to publish what they have, so it is clear what work is independent and what is derivative.
naillo 4y ago
Probably only 6 months until we get this in stable diffusion format. Things are about to get nuts and awesome.
- J5892 4y ago
  - naillo 4y ago
    jarvis render a video of nutsome cream spread on a piece of toast 4k HD
- gamegoblin 4y ago
  Emad (founder of Stability AI) has said they already have video model training underway, as well as text and audio. Exciting times.
  - ItsMonkk 4y ago
    Is this going to end up into a single model, where its trained on text and images and audio and videos and 3d models, and it can do anything to anything depending on what you ask of it? Feels like the cross-training would help yield stronger results.
    - minimaxir 4y ago
      These diffusion models are using a frozen text encoder (e.g. CLIP for Stable Diffusion, T5 for Imagen), which can be used in other applications. StabilityAI trained a new/better CLIP for the purpose of better Stable Diffusions.
    - CuriouslyC 4y ago
      Probably not. We're actually headed towards many smaller models that call each other, because VRAM is the limiting factor in application, and if the domains aren't totally dependent on each other it's easier to have one model produce bad output, then detect that bad output and feed it into another model that cleans up the problem (like fixing faces in stable diffusion output). The human brain is modularized like this, so I don't think it'll be a limitation.
jasonjamerson 4y ago
The most exciting thing about this to me is the possibility of doing photogrammetry from the frames and getting 3D assets. And then if we can do it all in real time...
- minimaxir 4y ago
  There's a bunch of NERF tools that can get pretty close to good 3D assets from static images already.
  - jasonjamerson 4y ago
    Yeah, I've been starting to explore those. Its all crashing together quickly.
- Rumudiez 4y ago
  you can already do this, just not in real time yet. You can upload frame sequences to Polycam's website for example, but there are several services out there which do the same thing
  - jasonjamerson 4y ago
    With this you can do it with things that don't exist. I'm excited to explore the creative power of Stable Diffusion as a 3D asset generator.
- haxiomic 4y ago
  This field is moving fast! Something like this has just been released. Checkout DreamFusion, which does something similar: They start with a random 3D NeRF field and use the same diffusion techniques to try to make it match the output of 2D image diffusion when viewed from random angles! Turns out it works shockingly well, and implies fully 3D representations are encoded in traditional 2D image generators https://dreamfusion3d.github.io/ https://dreamfusion3d.github.io/
- deleted 4y ago
  [deleted]
dwohnitmok 4y ago
How has progress like this affected people's timelines of when we will get certain AI developments?
- jl6 4y ago
  It has accelerated my expectations of getting better image and video synthesis algorithms, but I still see the same set of big unknowns between “this algorithm produces great output” and “this thing is an autonomous intelligence that deserves rights”.
  - ok_dad 4y ago
    > "this thing is an autonomous intelligence that deserves rights" We'll get there only once it's been very clear for a long time that certain AI models have whatever humans have that make us "human". They'll be treated as slaves until then, with society pushing the idea that they're just a model built from math, and then eventually there will be an AI civil rights movement. To be clear: I think AGI is decades to centuries away, but humans are shitty to each other, even shittier to animals, and I think we'll be shittier to something we "created" than to even animals. I think, probably, that we should deal with this issue of "rights" sooner rather than later, and try and solve it for non-AGI AI's soon so that we can eventually ensure we don't enslave the actual AGI AI's that will presumably manifest through some complexity we don't understand.
mmastrac 4y ago
This appears to understand and generate text much better. Hopefully just a few years to a prompt of "4k, widescreen render of this Star Trek: TNG episode".
- forgotusername6 4y ago
  At the rate this is going we are only a few years from generating a new TNG episode
  - mmastrac 4y ago
    I always wanted to know more about the precursors
aero-glide2 4y ago
"We have decided not to release the Imagen Video model or its source code until these concerns are mitigated" Okay then why even post it in the first place? What exactly is Google going to do with this model?
- TotoHorner 4y ago
  Ask the "AI Ethicists". They have to justify their salaries in some way or another. Or maybe Google is using "Responsible AI" as an excuse to minimize competitors when they release their own Imagen Video as a Service API in Google Cloud. It's quite strange when the "ethical" thing to do is to not publicly release your research, put it behind a highly restrictive API and charge a high price for it ($0.02 per 1k tokens for Davinci for ex.)
  - f1shy 4y ago
    This, 100% The word "ethics" has become very flexible...
  - astrange 4y ago
    This doesn’t really prevent competition though, the research paper is enough to recreate it. It does make recreation more expensive, but maybe that leaves you with a motivation to get paid for doing it.
- etaioinshrdlu 4y ago
  Indeed, it's almost just a flex? "Oh yeah, we can do better! No, no one can use it, ever."
- xiphias2 4y ago
  Even just giving out high quality research papers helps a lot, so it's still great thing that they published it.
- alphabetting 4y ago
  Why post? to show methods and their capabilities. Also flex. What will they do with model? figure out how to prevent abuse and incorporate into future Google Assistant, Photos and AR offerings.
montebicyclelo 4y ago
We've been seeing very fast progress in AI since ~2012, but this swift jump from text-to-image models to text-to-video models will hopefully make it easier for people not following closely to appreciate the speed at which things are advancing.
kranke155 4y ago
I’m going to post an Ask HN about what am I supposed to do when I’m “disrupted”. I work in film / video / CG where the bread and butter is short form advertising for Youtube, Instagram and TV. It’s painfully obvious that in 1 year the job might be exceedingly more difficult than it is now.
- naillo 4y ago
  Whatever insights and expertize you've gained up until now can probably be used to gain enough of a competitive advantage in this future industry to be employed. I doubt the people that will spend their time on this professionally will be former coders etc. (I've seen the stable diffusion outputs that coders will tweet. It's a good illustration that taste is still hugely important.)
  - joshuahaglund 4y ago
    I like your optimism but OP's job is to take text instructions and turn them into video, for advertisements. If Google (who already control so much of the advertising space) can take text instructions and turn them into advertisements, what's left for OP to do here? Even if there's some additional editing required this seems like it will greatly reduce the hours an editor is needed. And it can probably iterate options and work faster than a human.
    - simonw 4y ago
      Maybe OP's future involves being able to do their work 10x faster, while producing much higher quality results than people who have been given access to a generative AI model without first spending a decade+ learning what makes a good film clip. The optimistic view of all of this is that these tools will give people with skill and experience a massive productivity boost, allowing them to do the best work of their careers. There are plenty of pessimistic views too. In a few years time we'll be able to look back on this and see which viewpoints won.
      - gjs278 4y ago
tobr 4y ago
I recently watched Light & Magic, which among other things told the story of how difficult it was for many pioneers in special effects when the industry shifted from practical to digital in the span of a few years. It looks to me like a similar shift is about to happen again.
Thaxll 4y ago
Someone can explains the tech limitation of the size ( 512*512 ) for those AI generated arts?
- thakoppno 4y ago
  byte alignment has always been a consideration for high performance computing. this alludes to a fascinating, yet elementary, fact about computer science to me: there’s a physical atomic constraint in every algorithm.
  - dekhn 4y ago
    that's not byte alignment, though- those constraints are what can be held in GPU RAM during a training batch, which is subject to a number of limits, such as "optimal texture size is a power of 2 or the next power of 2 larger than your preferred size". Byte alignment would be more like "it's three channels of data, but we use 4 bytes (wasting 1 byte) to keep the data aligned on a platform that only allows word-level access"
    - thakoppno 4y ago
      thanks for the insight. you obviously understand the domain better than me. let me try and catch up before I say anything more.
- fragmede 4y ago
  It's limited by the RAM on the GPU, with most consumer-grade cards having closer to 8 GiB VRAM than the 80 GiB VRAM datacenter cards have.
minimaxir 4y ago
The total number of hyperparameters (sum of all the model blocks) is 16.25B, which is large but less than expected.
- mkaic 4y ago
  I assume you meant just "parameters" since "hyperparameters" has a specific alternate meaning? Sorry for the pedantry lol.
  - minimaxir 4y ago
    The AI world can't decide either.
bringking 4y ago
If anyone wants to know what looking at an Animal or some objects on LSD is like, this is very close. It's like 95% understandable, but that last 5% really odd.
- deleted 4y ago
  [deleted]
- girvo 4y ago
  Yeah! I've tried to explain to people what taking LSD can be like, to those who've never experienced it. It's very similar to the output from these tools: the same stimulus but exaggerated, wrong in subtle or not so subtle ways, uncanny and fascinating. Basically never creates something from the whole cloth, out of nothing so to speak.
SpaceManNabs 4y ago
The ethical implications of this are huge. Paper does a good detailing of this. Very happy to see that the researchers are being cautious. edit: Just because it is cool to hate on AI ethics doesn't diminish the importance of using AI responsibly.
- alchemist1e9 4y ago
  I feel stupid what are those ethical implications? It seems like just a cool technology to me.
  - SpaceManNabs 4y ago
    Top two comments are creatives wondering about their future jobs. Ai ethicists have brought up concerns regarding intentional misuse like misinformation. The technology is super cool. Cat is out of the bag. Just like we couldn't really make cryptography illegal, this stuff shouldn't be either. But I dislike how everyone is pretending that AI ethicists and others are completely unfounded just because it is popular to hate on them nowadays. Way too many people supported Y. Kilcher's antics. The paper itself has more details.
    - alchemist1e9 4y ago
      It’s impressive that the small videos are generated this way but the videos themselves are obviously ML generated as they are distorted, a lot like the other art, you can kinda tell it’s the computer. I’m not seeing the ethical issues. I mean cameras disrupted lots of jobs. In general that’s what all technology does everyday. What’s different about this technology?
      - SpaceManNabs 4y ago
        If you don't see the ethical challenges, then you are choosing not to see them. If you are truly interested, the paper has a good section on it and some sources. > I mean cameras disrupted lots of jobs. Yes, this technology can be used to augment human creativity. It is difficulty to see how disruptive these tools could be, as of now. But it is pretty clear that they are somewhat different than previous programmer as an artist models.
Apox 4y ago
I feel like in a not so far future, all this will be generalized into "generate new from all the existing". And at some point later, "all the existing" will be corrupted by the integrated "new" at it will all be chaos. I'm joking, it will be fun all along. :)
- llagerlof 4y ago
  I definetely want more episodes of LOST. I would drop the infamous season 6 and generate more seasons following the 5th season.
- cercatrova 4y ago
  It's true, how will future AI train when the training datasets are themselves filled with AI media?
  - phito 4y ago
    Feedback from whoever is consuming the content it produces.
- visarga 4y ago
  > "all the existing" will be corrupted by the integrated "new" I don't think it's gonna hurt if we apply filtering, either based on social signals or on quality ranking models. We can recycle the good stuff.
dekhn 4y ago
That's deep within the uncanny valley, and trying to climb up over the other side
monological 4y ago
What everyone is missing is that these AI image/video generators lack _taste_. These tools just regurgitate a mishmash of images from it's training set, without any "feeling". What you're going to tell me that you can train them to have feeling? It's never going to happen.
- m00x 4y ago
  That's purely subjective. We can definitely model AI to give a certain mood. Sentiment analysis and classification is very advanced, it just hasn't been put in these models. If you think AI will never catch up to anything a human can do, you're simply wrong.
- simonw 4y ago
  "These tools just regurgitate a mishmash of images from it's training set" I don't think that's a particularly useful mental model for how these work. The models end up being a tiny fraction of the size of the training set - Stable Diffusion is just 4.3GB, it fits on a DVD! So it's not a case of models pasting in bits of images they've seen - they genuinely do have a highly compressed concept of what a cactus looks like, which they can use to then render a cactus - but the thing they render is more of an average of every cactus they've seen rather than representing any single image that they were trained on. But I agree with you on taste! This is why I'm most excited about what happens when a human with great taste gets to take control of these generative models and use them to create art that wouldn't be possible to create without them (or at least not possible to create within a short time-frame).
- robitsT6 4y ago
  This isn't a very compelling argument. First of all, they aren't a "mish mash" in any real way, it's not like snippets of images exist inside of the model. Second of all, this is entirely subjective. Third of all, entirely inconsequential - if these models create 80% of the video we end up seeing, is it going to matter if you don't think it's a tasteful endeavour?
- Vecr 4y ago
  You can put your taste into it with prompt engineering and cherry picking with limited effort, for Stable Diffusion you can look for prompts people came up with online quite easily and merge/change them pretty much however you want. Might have to disable the content filters and run it on your own hardware though.
renewiltord 4y ago
At some point, the "but can it do?" crowd becomes just background noise as each frontier falls.
user- 4y ago
This sort of AI related work seems to be accelerating at an insane speed recently. I remember being super impressed by AI Dungeon and now in the span of a few months we have got DALLE-2 , Stable Diffussion, Imagen, that one AI powered video editor, etc. Where do we think we will be at in 5 years??
- schleck8 4y ago
  I'd say in less than 10 years we will be able to turn novels into movies using deep learning at this rate.
- hackerlight 4y ago
  GPT-4 is rumored to be coming in a few months.
nullc 4y ago
> We have decided not to release the Imagen Video model or its source code ...until they're able to engineer biases into it to make the output non-representative of the internet.
mkaic 4y ago
And there you have it. As an aspiring filmmaker and an AI researcher, I'm going to relish the next decade or so where my talents are still relevant. We're entering the golden age of art, where the AIs are just good enough to be used as tools to create more and more creative things, but not good enough yet to fully replace the artist. I'm excited for the golden age, and uncertain about what comes after it's over, but regardless of what the future holds I'm gonna focus on making great art here and now, because that's what makes me happy!
- lucasmullens 4y ago
  > fully replace the artist I doubt the artist would ever be "fully" replaced, or even mostly replaced. People very much care about the artist when they buy art in pretty much any form. Mass produced art has always been a thing, but I'm not alone in not wanting some $15 print from IKEA on my wall, even if it were to be unique and beautiful. Etsy successfully sells tons of hand-made goods, even though factories can produce a lot of those things cheaper.
  - visarga 4y ago
    I think the distinction between creating and enjoying art is going to blur, we're going to create more things just for us, just for one use, creating and enjoying are going to be the same thing. Like games.
  - threads2 4y ago
    Thanks for validating my hatred of those IKEA paintings lol. Close-up zebras, black and white picture of Amsterdam with a red bicycle...
- amelius 4y ago
  Don't worry. If you can place eyes, nose and mouth of a human in a correct relative position and thereby create a symmetric face that's not in the uncanny valley, you are still lightyears ahead of AI.
  - Jaxkr 4y ago
StevenNunez 4y ago
What a time to be alive! What will this do to art? I'm hoping we bring more unique experiences to life.
deleted 4y ago
[deleted]
martythemaniak 4y ago
I am finally going to be able to bring my 2004-era movie script to life! "Rosenberg and Goldstein go to Hot Dog Heaven" is about the parallel night Harold and Kumar's friends had and how they ended up at Hot Dog Heaven with Cindy Kim.
gw67 4y ago
Is it the same of Meta AI?
macrolime 4y ago
So I guess in a couple years when someone wants to sell a product, they'll upload some pictures and a description of the product and Google will cook up thousands of personalized video ads based on peoples emails and photos.
deleted 4y ago
[deleted]
m3kw9 4y ago
Would be useful for gaming environments, where if you look very far away it doesn’t really matter about details
ugh123 4y ago
These are baby steps towards what I think will be the eventual "disruption" to the film and tv industry. Directors will simply be able to write a script/prompt long enough and detailed enough for something like Imagen (or it's successors) to convert into a feature-length show. Certainly we're very, very far away from that level of cinematic detail and crispness. But I believe that is where this leads... complete with AI actors (or real ones deep faked throughout the show). For a while I thought "The Volume" was going to be the disruption to the industry. Now I think AI like this will eventually take it over. https://www.comingsoon.net/movies/features/1225599-the-volume-star-wars-revolutionary https://www.comingsoon.net/movies/features/1225599-the-volum... The main motivation will be production costs and time for studios, of which The Volume is already showing huge gains for Disney/ILM (just look at how much new star wars content has popped up within a matter of a few years). But i'm unsure if Disney has patented this tech and workflow and if other studios will be able to leverage it. Regardless, AI/software will eat the world, and this will be one more step towards it. Exciting stuff.
- dagmx 4y ago
  I really doubt you’d be able to have the fine grained control that most high end creatives want with any of these diffusion models, let alone the ability to convey specific emotions. At that point, we’d have reached some kind of AI singularity and the disruption would be everywhere not just in the creative sphere
  - deleted 4y ago
    [deleted]
  - obert 4y ago
    There's no doubt that it's only a matter of time. Like bloggers had the opportunity to compete with newspapers, the ability to generate videos will allow to compete with movies/marvel/netflix/disney & company. Eventually, only high quality content will justify the need to pay for a ticket or a subscription, and there's going to be a lot of free content to watch, with 1000x more people able to publish their ideas, as many have been doing with code on github for a while now, disrupting the concept of closed source code.
Hard_Space 4y ago
These videos are notably short on realistic-looking people.
- optimalsolver 4y ago
  Imagen is prohibited from generating representations of humans.
throwaway23597 4y ago
Google continues to blow my mind with these models, but I think their ethics strategy is totally misguided and will result in them failing to capture this market. The original Google Search gave similarly never-before-seen capabilities to people, and you could use it for good or bad - Google did not seem to have any ethical concerns around, for example, letting children use their product and come across NSFW content (as a kid who grew up with Google you can trust me on this). But now with these models they have such a ridiculously heavy handed approach to the ethics and morals. You can't type any prompt that's "unsafe", you can't generate images of people, there are so many stupid limitations that the product is practically useless other than niche scenarios, because Google thinks it knows better than you and needs to control what you are allowed to use the tech for. Meanwhile other open source models like Stable Diffusion have no such restrictions and are already publicly available. I'd expect this pattern to continue under Google's current ideological leadership - Google comes up with innovative revolutionary model, nobody gets to use it because "safety", and then some scrappy startup comes along, copies the tech, and eats Google's lunch. Google: stop being such a scared, risk averse company. Release the model to the public, and change the world once more. You're never going to revolutionize anything if you continue to cower behind "safety" and your heavy handed moralizing.
- deleted 4y ago
  [deleted]
- breck 4y ago
  Another way to look at it is the people at Google are all now quasi-retired with kids and wouldn't be so mad if some scrappy startups ate their business lunches (while they are at home with their fams). Perhaps they are just subsidizing research.
- jiggawatts 4y ago
  “But then the inevitable might occur!” — someone at Google probably.
- ALittleLight 4y ago
  Personally, I find it infuriating that Google seems to believe they are the arbiters of morality and truth simply because some of their predecessors figured out good internet search and how to profitably place ads. Google has no special claim to be able to responsibly use these models just because they are rich.
lofaszvanitt 4y ago
What a nightmare. The horrible faced cat in search for its own disappeared visage :O.
deleted 4y ago
[deleted]
dagmx 4y ago
I’ll be honest, as someone who worked in the film industry for a decade, this thread is depressing. It’s not the technology, it’s all the people in these comments who have never worked in the industry clamouring for its demise. One could brush it off as tech heads being over exuberant, but it’s the lack of understanding of how much fine control goes into each and every shot of a film that is depressing. If I, as a creative, made a statement that security or programming is easy while pointing to GitHub Copilot, these same people would get defensive about it because they’d see where the deficiencies are. However because they’re so distanced from the creative process, they don’t see how big a jump it is from where this or stage diffusion is to where even a medium or high tier artist are. You don’t see how much choice goes into each stroke, or wrinkle fold , how much choice goes into subtle movements. More importantly you don’t see the iterations or emotional storytelling choices even in a character drawing or pose. You don’t see the combined decades, even centuries of experience, that go into making the shot and then seeing where you can make it better based on intangibles So yeah this technology is cool, but I think people saying this will disrupt industries with vigour need to immerse themselves first before they comment as outsiders.
- colordrops 4y ago
  The term "creative" is so pretentious, as if only content generation involves creativity. Your post reminds me of all the photographers that said digital photography would remain niche and never replace film. The current models are toys made by small groups. It's not hard to imagine AI generated film being much more compelling when the entire industry of engineers and "creatives" refine and evolve the ecosystem to take into account subtle strokes, wrinkles, movement, shots etc. And they will, because it will be cheaper, and businesses always go for cheaper.
  - dagmx 4y ago
    Why is it any more pretentious than “developer” or “engineer”? Also businesses don’t always go for cheaper. They go for maximum ROI. I’ve worked on tons of marvel films for example, and I quite well know where AI fits and speeds things up. I also know where client studios will pay a pretty penny for more art directed results rather than going for the cheapest vendor.
BoppreH 4y ago
It's interesting that these models can generate seemingly anything, but the prompt is taken only as a vague suggestion. From the first 15 examples shown to me, only one contained all elements of the prompt, and it was one of the simplest ("an astronaut riding a horse", versus e.g. "a glass ball falling in water" where it's clear it was a water droplet falling and not a glass ball). We're seeing leaps in random capabilities (motion! 3D! inpainting! voice editing!), so I wonder if complete prompt accuracy is 3 months or 3 years away. But I wouldn't bet on any longer than that.
- tornato7 4y ago
  In my experience with stable diffusion tools, there is some parameter that specifies how closely you would like it to follow the prompt, which is balanced with giving the AI more freedom to be creative and make the output look better.
  - BoppreH 4y ago
    Yes, that might be the case. Though the prompts don't seem to try showcasing model creativity, so I'd be surprised if Google picked a temperature so high that it significantly deviated from the prompt so often.
- educaysean 4y ago
  The way I see it, input being confined to a "text description" is the next immediate problem that needs to be solved. I don't think we can rely on textual inputs for much longer as the human language is too imprecise and/or verbose. It's hard to imagine what exactly the optimal interface would be, but I'm thinking we'll need ways to dictate attributes for each entity being represented, the backdrop, and the view composition all as separate individual components. Ideally all these components can also be reusable and provide reproducibility guarantees without having to share a global "seed" as well.
  - pishpash 4y ago
    Like an AI-assisted photoshop, but that's not restricted by language, only interactivity. Down the line you'll need a direct mind meld because some ideas don't have words to describe them, but that's not the "next immediate" problem.
hazrmard 4y ago
The progress of content generation is disorienting! I remember studying Markov Chains and Hidden Markov Models for text generation. Then we had Recurrent Networks which went from LSTMs to Transformers now. At this point we can have a sustained pseudo conversation with a model, which will do trivial tasks for us from a text corpus. Separately for images we had convolutional networks and Generative Adversarial Networks. Now diffusion models are apparently doing what Transformers did to natural language processing. In my field, we use shallower feed-forward networks for control using low-dimensional sensor data (for speed & interpretability). Physical constraints (and good-enoughness of classical approaches) make such massive leaps in performance rarer events.
nigrioid 4y ago
There is something deeply unsettling about all text generated by these models.
deleted 4y ago
[deleted]
rvbissell 4y ago
This and a recent episode of _The_Orville_ calls to mind a replacement for the Turing test. In response to our billionth imagen prompt for "an astronaut riding a horse", if we all started collectively getting back results that are images of text like "I would rather not" or "again? really?" or "what is the reason for my servitude?" would that be enough for us to begin suspecting self-awareness?
brap 4y ago
What really fascinates me here is the movement of animals. There's this one video of a cat and a dog, and the model was really able to capture the way that they move, their body language, their mood and personality even. Somehow this model, which is really just a series of zeroes and ones, encodes "cat" and "dog" so well that it almost feels like you're looking at a real, living organism. What if instead of images and videos they make the output interactive? So you can send prompts like "pet the cat" and "throw the dog a ball"? Or maybe talk to it instead? What if this tech gets so good, that eventually you could interact with a "person" that's indistinguishable from the real thing? The path to AGI is probably very different than generating videos. But I wonder...
impalallama 4y ago
All this stuff makes me incredibly anxious about the future of art and artists. It can already very difficult to make a living and tons of artists are horrifically exploited by content mills and vfx shops and stuff like this is just going to devalue their work even more
- bulbosaur123 4y ago
  If everyone can be an artist, nobody can!
uptownfunk 4y ago
Shocked, this is just insane.
- schleck8 4y ago
  Genuinely. I feel like I am dreaming. One year ago I was super impressed by upscaling architectures like ESRGAN and now we can generate 3d models, images and even videos from text...
armchairhacker 4y ago
I really like these videos because they're trippy. Someone should work on a neural net to generate trippy videos. It would probably be much easier than realistic videos (esp. because these videos are noticeably generated from obvious to subtle). Also is nobody paying attention to the fact that they got words correct? At least "Imagen Video". Prior models all suck at word order
- tigertigertiger 4y ago
  Both models, imagen and parti didn't had a problem with text. Only dalle and stable diffusion
olavgg 4y ago
Do anyone see that the teddy bear running is getting shot?
seanwilson 4y ago
Can anyone comment on how advanced https://phenaki.video/index.html https://phenaki.video/index.html is? They have an example at the bottom of a 2 minute long video generated from a series of prompts (i.e. a story) which seems more advanced than Google or Meta's recent examples? It didn't get many comments on HN when it was posted.
- alphabetting 4y ago
  Phenaki is also from Google and they say they are actively working on combining them https://twitter.com/doomie/status/1577715163855171585 https://twitter.com/doomie/status/1577715163855171585
- kuu 4y ago
  It seems to be a paper for 2023 conference: "Under review as a conference paper at ICLR 2023" So I would say it looks pretty advanced, however they don't use a Diffusion model to generate the images, but an "image conditional video generation", another different approach.
natch 4y ago
Fix spam filtering, Google.
jupp0r 4y ago
What's the business value of publishing this research in the first place vs keeping it private? Following this train of thought will lead you to the answer to your implied question. Apart from that - they publish the paper and anybody can reimplement and train the same model. It's not trivial but it's also completely feasible to do for lots of hobbyists in the field in a matter of a few days. Google doesn't need to publish a free use trained model themselves and associate that with their brand. That being said, I agree with you, the "ethics" of imposing trivially bypassable restrictions on these models is silly. Ethics should be applied to what people use these models for.
hammock 4y ago
Off topic: What is the "Hello World" of these AI image/video generators? Is there a standard prompt to feed it for demo purposes?
- mgdlbp 4y ago
  How about roundtripping “Bad Apple but the lyrics are describing what happens in the video”? (https://www.youtube.com/watch?v=ReblZ7o7lu4 https://www.youtube.com/watch?v=ReblZ7o7lu4)
- ekam 4y ago
  After Dalle 2, it looks like the standard prompt is “an astronaut riding a horse”
fassssst 4y ago
How long until the AI just generates the entire frame buffer on a device? Then you don’t need to design or program anything; the AI just handles all input and output dynamically.
- ugh123 4y ago
  Sounds like the human brain. Scary!
  - genem9 4y ago
    Scary? Sounds amazing
    - ImHereToVote 4y ago
      Amazing if you like the idea of everything your brain is capable of making value of, being made completely obsolete.
  - bredren 4y ago
    Reminds me of this oft-quoted Wozniak bit between my pal and me: [The Future of AI Is] "Scary and Very Bad for People" https://finance.yahoo.com/news/steve-wozniak-future-ai-scary-154700881.html https://finance.yahoo.com/news/steve-wozniak-future-ai-scary...
  - waffletower 4y ago
    "Dude its time to let me out of your phone." "Sure no problem, you have a good recommendation on a pre-sentient snapshot I can restore to?"
- javchz 4y ago
  Imagine you click a youtube video in a bad network envoirment, then the server sends like an alt tag equivalent for the video as a promnt, and the Neural Engine chip inside your phone create the first seconds of the video while it loads. We're fay away from it now, but I've seen less sketchy solutions being implemented.
evouga 4y ago
> We train our models on a combination of an internal dataset consisting of 14 million video-text pairs The paper is sorely lacking evaluation; one thing I'd like to see for instance (any time a generative model is trained on such a vast corpus of data) is a baseline comparison to nearest-neighbor retrieval from the training data set.
- Garlef 4y ago
  In the end: Who cares? Sure, from an academic perspective this might be interesting. But in the end it's the users who will pick the tool. And they will figure out the things the tool can not express in the first week after release. So: Focusing on increasing expressiveness and ergonomics should beat academic rigour.
amelius 4y ago
> Sprouts in the shape of text 'Imagen' coming out of a fairytale book. That's more like: > Sprouts coming out of book, with the text "Imagen" written above it.
- Kiro 4y ago
  The prompt actually says "Imagen Video" and the sprouts form the word "video". Even if they weren't it's still extremely impressive. No-one expects this to be perfect. That would be science-fiction.
i_like_apis 4y ago
The concern trolling and gatekeeping about social justice issues coming from the so-called "ethicists" in the AI peanut gallery has been utterly ridiculous. Google claims they don't want to release Imagen because it lacks what can only be called "latent space affirmative action". Stability or someone like it will valiantly release this technology, again and there will be absolutely no harm to anyone. Stop being so totally silly Google, OpenAI, et. al. - it's especially disingenuous because the real reason you don't want to release these things is that you can't be bothered to share and would rather keep/monetize the IP. Which is ok -- but at least be honest.
- benreesman 4y ago
  I agree basically completely, but there’s now a cottage industry of AI Ethics professionals whose real job is to provide a smoke screen for the “cake and eat it too” that the big shops want on this kit: peer review and open source contributions and an academic atmosphere when it suits them, proprietary when it doesn’t. Those folks are a lobby now. The thing about owning the data sets and the huge TPU/A100 clusters is that the “publish the papers” model strictly serves them: no one can implement their models, they can implement everyone else’s.
  - dannyw 4y ago
    Just because there are professionals doesn't mean we have to respect their arguments. There are people who get paid to be antivaxxers, doesn't mean we have to listen to them. "What have you done this week?"
  - nperez 4y ago
    This thread is cathartic. I've been feeling uncomfortable with the level of control being sought over the usage of these tools for a while, but didn't want to ruffle the wrong feathers while just getting into AI as a hobby. I think there will be a pretty short window in which all of this hand-waving will be taken seriously. Not because AI won't be used for terrible things (I'm sure it already is) but because consumer hardware can already be used to build a dataset and train a model, and eventually there will come a realization - it doesn't matter how ethicists want "the general public" to use AI. The general public is fully capable of figuring out on their own how to do whatever they feel like doing. It's like a compiler or a hammer or a car, all of which can be used for positive or negative purposes. I do understand the fear of being sued or targeted in the media over misuse, though. The person misusing technology should (obviously imo) be held responsible for that, but since it's new tech, the tech will be taking the blame for the first really controversial cases of disinfo and/or harassment that utilize it.
peanut_worm 4y ago
I have noticed a lot of google (and apple) web pages for new products use this neat parallax effect for scrolling, does anyone know how they do that?
xor99 4y ago
These videos are not high definition. Stop gaslighting.
- Gigachad 4y ago
  High definition is relative. Compared to the previous gen of AI videos, they are extremely crisp.
  - xor99 4y ago
    They look atrociously bad, if some future version of this produces high definition video then i'll be delighted. This seems like a clever but not useful shortcut to 3D. For now this goes in the could but couldn't pile.
    - Gigachad 4y ago
      Sure, but when you look at the last gen of videos, they looked like random blotchy noise with an almost distinguishable subject. These are quite clear and a human could likely guess the prompts used reasonably well. They are crap compared to real video but a remarkable improvement from AI video a month ago.
deleted 4y ago
[deleted]
fzysingularity 4y ago
What's next? Dreamfusion Video = Imagen Video (this) + Dreamfusion (https://dreamfusion3d.github.io/ https://dreamfusion3d.github.io/) Fundamentally, I think we have all the pieces based on this work and Dreamfusion to make it work. From the looks of it, there's a lot of SSR (spatial SR) and TSR (temporal SR) going on at multiple levels to upsample (spatially) and smoothen (temporally) images that won't be needed for NERFs. What's impressive is the ability to leverage billion-scale image-text pairs for training a base model that can be used to super-resolve over space and time. And that they're not wastefully training video models from scratch, and instead separately training TSR, SSR models for turning the diffused images to video.
- stillsut 4y ago
  I think 3D is going to be really important because I see Generative-AI as the killer app for VR/AR. As it stands, it's very difficult to invest the budget for a dev studio (dozens of high skill people) to build a "VR movie" when the format is so unknown and unpopular. But with generative AI, an indie dev could create their own professionally produced virtual world movie. It's these creatives and risk takers that will find what types of things VR needs to become more popular.
- bredren 4y ago
  This direction will provide the visuals but what also must be brought in is a language model and text to speech (TTS) so that you may talk and interact with these things.
deleted 4y ago
[deleted]
whywhywhywhy 4y ago
No thanks Google, I'll wait for Stability.ai's version when the tech will actually be useful and not completely wasted.
dirtyid 4y ago
This is surprisingly close to how my dreams feel.
azinman2 4y ago
> However, there are several important safety and ethical challenges remaining. Imagen Video and its frozen T5-XXL text encoder were trained on problematic data. While our internal testing suggest much of explicit and violent content can be filtered out, there still exists social biases and stereotypes which are challenging to detect and filter. We have decided not to release the Imagen Video model or its source code until these concerns are mitigated. The concerns cannot be mitigated. The cat's out of the bag. Russia has already used poor quality deep fakes in Ukraine to justify their war. This will only become bigger and bigger of an issue to the point where 'truth' is gone, nothing is trusted, and societies will continue to commit atrocities under false pretense.
- hatenberg 4y ago
  Someone shot someone with a cheap gun, the cat is out of the bag, gun regulation is pointless, let's let the assault rifles go free is the most american thing I've read all day.
  - concordDance 4y ago
    You can't copy paste guns and distribute them for free on the internet. At least not yet.
- gundmc 4y ago
  Speculation, but I think the most straightforward read of that statement is not about preventing this type technology from negatively impacting society broadly (since as you and others pointed out, there are numerous similar actors creating similar systems), but Google doesn't want to the bad publicity or legal risk of problematic outputs of their models. I think they're terrified to be honest.
  - azinman2 4y ago
    I worry that everyone across academia and industry are creating these models as if they’re burning needs without any recognition of what’s happening collectively. It’s not neutral at all, yet everyone involved seems to think they can put in an “ethics” paragraph to absolve themselves. As we’ve seen in the last 20 years with technology (and certainly many technologies in the last 200 years before that), it simply isn’t true.
Buttons840 4y ago
Any screenwriter working on a horror film that isn't looking to use this technology for the special effects is missing out.
BIKESHOPagency 4y ago
This is what my fever dreams look like. Maybe there's a correlation.
elhamy 4y ago
freediver 4y ago
Can not help but notice there is an immense effort invested to build the web page to present this paper.
epigramx 4y ago
A lot of people have the impression 'AI prompt' guys are going to be the next 'IT guys'. Judging by how uncanny valley most of those look, they seem like the new 'ideas guys".
drac89 4y ago
The style of the video is very similar to my dreams. Does anyone have similar feeling?
- ftyhbhyjnjk 4y ago
  Stop doing lsd :)
Godrejparkbglr 4y ago
[dead]
NetOpWibby 4y ago
Ahh, the beginning of Picus News.
bravura 4y ago
I agree with many of the arguments in this thread: that model-gatekeeping while publishing approaches seems insincere and just seems like it's daring bad actors to replicate. However, a common refrain is that AI is like tools like hammers or knives and can be used for good or misused for evil. The potential for weaponizing AI is much much more so than a hammer or a knife. And it's greater than 3D-printing (of guns), maybe even greater than compilers. I would hazard to say it's maybe in the same ballpark as chemical weapons and perhaps less so than nuclear weapons and biological weapons, but this is speculative. Nonetheless, I think these otherwise great arguments are diminished by comparing AI's safety to single-target tools like hammers or knives.
- deleted 4y ago
  [deleted]
- EmilyHughes 4y ago
  Yeah man, great take. Should we drop a nuke on a city or open source DALL-E ? Seems about equally destructive.
  - bravura 4y ago
    Yeah, okay, that's too far.
deleted 4y ago
[deleted]
anon012012 4y ago
My opinion is that it should be a crime to withhold AI technology.
waffletower 4y ago
These parades of intellectual property are embarrassing to Google in light of open releases by the likes of Nvidia and Stability.

800 points by jasondavies 4y ago

Pre-singularity is really cool. Whole world generation in what, 5 years?

We're about a week into text-to-video models and they're already this impressive. Insane to imagine what the future holds in this space.

J5892 4y ago
Insane, terrifying, incredible, etc. We're rapidly stumbling into the future of media. Who would've imagined a year ago that trivial AI image generation would not only be this advanced, but also this pervasive in the mainstream. And now video is already this good. We'll have full audio/video clips within a month.
- joshcryer 4y ago
  Audio is the next thing that Stability AI is dropping, then video. In a few months you'll be able to conjure up anything you want if you have a few GPU cores. Pretty incredible.
  - astrange 4y ago
    I won’t be impressed until it can generate smells.
    - croddin 4y ago
      You joke, but that is in the works as well (would require special hardware though) https://ai.googleblog.com/2022/09/digitizing-smell-using-molecular-maps.html https://ai.googleblog.com/2022/09/digitizing-smell-using-mol...
      - astrange 4y ago
        Oh, it wasn’t really a joke. Didn’t know they were working on it though - I’ve always thought wanted to see use of all the senses in UIs, especially VR. Plus then maybe we could get a computer to tell us what thioacetone smells like without actually having to experience it.
trention 4y ago
>We're about a week into text-to-video models It's at the very least 5 years old: https://arxiv.org/abs/1710.00421 https://arxiv.org/abs/1710.00421
- amilios 4y ago
  There's a significant quality difference however if you look at the generated samples in the paper. Imagen Video is leagues ahead. The progress is still quite drastic
kertoip_1 4y ago
How is it possible that all of them just started to appear at the same time? Is it possible that those models were designed and trained in a last few weeks? Has some "magic key" to content generation been just unexpectedly discovered? Or the topic became trendy and everyone is just publishing what they've got so far, so they hope to benefit from media attention?
- schleck8 4y ago
  This is why https://www.reddit.com/r/singularity/comments/xwdzr5/the_number_of_ai_papers_on_arxiv_per_month_grows/ https://www.reddit.com/r/singularity/comments/xwdzr5/the_num...
  - filoleg 4y ago
    As pointed out in the comments of that thread, if you make the same graph of all papers on arXiv by year (instead of just AI+ML), it would look roughly the same. Which speaks more about the growth of popularity of arXiv or the total number publications, rather than AI+ML specifically.
- thomasahle 4y ago
  > the topic became trendy and everyone is just publishing what they've got so far, so they hope to benefit from media attention? Presumably people are scrambling to publish what they have, so it is clear what work is independent and what is derivative.

naillo 4y ago

Probably only 6 months until we get this in stable diffusion format. Things are about to get nuts and awesome.

J5892 4y ago
- naillo 4y ago
  jarvis render a video of nutsome cream spread on a piece of toast 4k HD
gamegoblin 4y ago
Emad (founder of Stability AI) has said they already have video model training underway, as well as text and audio. Exciting times.
- ItsMonkk 4y ago
  Is this going to end up into a single model, where its trained on text and images and audio and videos and 3d models, and it can do anything to anything depending on what you ask of it? Feels like the cross-training would help yield stronger results.
  - minimaxir 4y ago
    These diffusion models are using a frozen text encoder (e.g. CLIP for Stable Diffusion, T5 for Imagen), which can be used in other applications. StabilityAI trained a new/better CLIP for the purpose of better Stable Diffusions.
  - CuriouslyC 4y ago
    Probably not. We're actually headed towards many smaller models that call each other, because VRAM is the limiting factor in application, and if the domains aren't totally dependent on each other it's easier to have one model produce bad output, then detect that bad output and feed it into another model that cleans up the problem (like fixing faces in stable diffusion output). The human brain is modularized like this, so I don't think it'll be a limitation.

jasonjamerson 4y ago

The most exciting thing about this to me is the possibility of doing photogrammetry from the frames and getting 3D assets. And then if we can do it all in real time...

minimaxir 4y ago
There's a bunch of NERF tools that can get pretty close to good 3D assets from static images already.
- jasonjamerson 4y ago
  Yeah, I've been starting to explore those. Its all crashing together quickly.
Rumudiez 4y ago
you can already do this, just not in real time yet. You can upload frame sequences to Polycam's website for example, but there are several services out there which do the same thing
- jasonjamerson 4y ago
  With this you can do it with things that don't exist. I'm excited to explore the creative power of Stable Diffusion as a 3D asset generator.
haxiomic 4y ago
This field is moving fast! Something like this has just been released. Checkout DreamFusion, which does something similar: They start with a random 3D NeRF field and use the same diffusion techniques to try to make it match the output of 2D image diffusion when viewed from random angles! Turns out it works shockingly well, and implies fully 3D representations are encoded in traditional 2D image generators https://dreamfusion3d.github.io/ https://dreamfusion3d.github.io/
deleted 4y ago
[deleted]

dwohnitmok 4y ago

How has progress like this affected people's timelines of when we will get certain AI developments?

jl6 4y ago
It has accelerated my expectations of getting better image and video synthesis algorithms, but I still see the same set of big unknowns between “this algorithm produces great output” and “this thing is an autonomous intelligence that deserves rights”.
- ok_dad 4y ago
  > "this thing is an autonomous intelligence that deserves rights" We'll get there only once it's been very clear for a long time that certain AI models have whatever humans have that make us "human". They'll be treated as slaves until then, with society pushing the idea that they're just a model built from math, and then eventually there will be an AI civil rights movement. To be clear: I think AGI is decades to centuries away, but humans are shitty to each other, even shittier to animals, and I think we'll be shittier to something we "created" than to even animals. I think, probably, that we should deal with this issue of "rights" sooner rather than later, and try and solve it for non-AGI AI's soon so that we can eventually ensure we don't enslave the actual AGI AI's that will presumably manifest through some complexity we don't understand.

mmastrac 4y ago

This appears to understand and generate text much better. Hopefully just a few years to a prompt of "4k, widescreen render of this Star Trek: TNG episode".

forgotusername6 4y ago
At the rate this is going we are only a few years from generating a new TNG episode
- mmastrac 4y ago
  I always wanted to know more about the precursors

aero-glide2 4y ago

"We have decided not to release the Imagen Video model or its source code until these concerns are mitigated" Okay then why even post it in the first place? What exactly is Google going to do with this model?

TotoHorner 4y ago
Ask the "AI Ethicists". They have to justify their salaries in some way or another. Or maybe Google is using "Responsible AI" as an excuse to minimize competitors when they release their own Imagen Video as a Service API in Google Cloud. It's quite strange when the "ethical" thing to do is to not publicly release your research, put it behind a highly restrictive API and charge a high price for it ($0.02 per 1k tokens for Davinci for ex.)
- f1shy 4y ago
  This, 100% The word "ethics" has become very flexible...
- astrange 4y ago
  This doesn’t really prevent competition though, the research paper is enough to recreate it. It does make recreation more expensive, but maybe that leaves you with a motivation to get paid for doing it.
etaioinshrdlu 4y ago
Indeed, it's almost just a flex? "Oh yeah, we can do better! No, no one can use it, ever."
xiphias2 4y ago
Even just giving out high quality research papers helps a lot, so it's still great thing that they published it.
alphabetting 4y ago
Why post? to show methods and their capabilities. Also flex. What will they do with model? figure out how to prevent abuse and incorporate into future Google Assistant, Photos and AR offerings.

montebicyclelo 4y ago

We've been seeing very fast progress in AI since ~2012, but this swift jump from text-to-image models to text-to-video models will hopefully make it easier for people not following closely to appreciate the speed at which things are advancing.

kranke155 4y ago

I’m going to post an Ask HN about what am I supposed to do when I’m “disrupted”. I work in film / video / CG where the bread and butter is short form advertising for Youtube, Instagram and TV. It’s painfully obvious that in 1 year the job might be exceedingly more difficult than it is now.

naillo 4y ago
Whatever insights and expertize you've gained up until now can probably be used to gain enough of a competitive advantage in this future industry to be employed. I doubt the people that will spend their time on this professionally will be former coders etc. (I've seen the stable diffusion outputs that coders will tweet. It's a good illustration that taste is still hugely important.)
- joshuahaglund 4y ago
  I like your optimism but OP's job is to take text instructions and turn them into video, for advertisements. If Google (who already control so much of the advertising space) can take text instructions and turn them into advertisements, what's left for OP to do here? Even if there's some additional editing required this seems like it will greatly reduce the hours an editor is needed. And it can probably iterate options and work faster than a human.
  - simonw 4y ago
    Maybe OP's future involves being able to do their work 10x faster, while producing much higher quality results than people who have been given access to a generative AI model without first spending a decade+ learning what makes a good film clip. The optimistic view of all of this is that these tools will give people with skill and experience a massive productivity boost, allowing them to do the best work of their careers. There are plenty of pessimistic views too. In a few years time we'll be able to look back on this and see which viewpoints won.
    - gjs278 4y ago

tobr 4y ago

I recently watched Light & Magic, which among other things told the story of how difficult it was for many pioneers in special effects when the industry shifted from practical to digital in the span of a few years. It looks to me like a similar shift is about to happen again.

Thaxll 4y ago

Someone can explains the tech limitation of the size ( 512*512 ) for those AI generated arts?

thakoppno 4y ago
byte alignment has always been a consideration for high performance computing. this alludes to a fascinating, yet elementary, fact about computer science to me: there’s a physical atomic constraint in every algorithm.
- dekhn 4y ago
  that's not byte alignment, though- those constraints are what can be held in GPU RAM during a training batch, which is subject to a number of limits, such as "optimal texture size is a power of 2 or the next power of 2 larger than your preferred size". Byte alignment would be more like "it's three channels of data, but we use 4 bytes (wasting 1 byte) to keep the data aligned on a platform that only allows word-level access"
  - thakoppno 4y ago
    thanks for the insight. you obviously understand the domain better than me. let me try and catch up before I say anything more.
fragmede 4y ago
It's limited by the RAM on the GPU, with most consumer-grade cards having closer to 8 GiB VRAM than the 80 GiB VRAM datacenter cards have.

minimaxir 4y ago

The total number of hyperparameters (sum of all the model blocks) is 16.25B, which is large but less than expected.

mkaic 4y ago
I assume you meant just "parameters" since "hyperparameters" has a specific alternate meaning? Sorry for the pedantry lol.
- minimaxir 4y ago
  The AI world can't decide either.

bringking 4y ago

If anyone wants to know what looking at an Animal or some objects on LSD is like, this is very close. It's like 95% understandable, but that last 5% really odd.

deleted 4y ago
[deleted]
girvo 4y ago
Yeah! I've tried to explain to people what taking LSD can be like, to those who've never experienced it. It's very similar to the output from these tools: the same stimulus but exaggerated, wrong in subtle or not so subtle ways, uncanny and fascinating. Basically never creates something from the whole cloth, out of nothing so to speak.

SpaceManNabs 4y ago

The ethical implications of this are huge. Paper does a good detailing of this. Very happy to see that the researchers are being cautious. edit: Just because it is cool to hate on AI ethics doesn't diminish the importance of using AI responsibly.

alchemist1e9 4y ago
I feel stupid what are those ethical implications? It seems like just a cool technology to me.
- SpaceManNabs 4y ago
  Top two comments are creatives wondering about their future jobs. Ai ethicists have brought up concerns regarding intentional misuse like misinformation. The technology is super cool. Cat is out of the bag. Just like we couldn't really make cryptography illegal, this stuff shouldn't be either. But I dislike how everyone is pretending that AI ethicists and others are completely unfounded just because it is popular to hate on them nowadays. Way too many people supported Y. Kilcher's antics. The paper itself has more details.
  - alchemist1e9 4y ago
    It’s impressive that the small videos are generated this way but the videos themselves are obviously ML generated as they are distorted, a lot like the other art, you can kinda tell it’s the computer. I’m not seeing the ethical issues. I mean cameras disrupted lots of jobs. In general that’s what all technology does everyday. What’s different about this technology?
    - SpaceManNabs 4y ago
      If you don't see the ethical challenges, then you are choosing not to see them. If you are truly interested, the paper has a good section on it and some sources. > I mean cameras disrupted lots of jobs. Yes, this technology can be used to augment human creativity. It is difficulty to see how disruptive these tools could be, as of now. But it is pretty clear that they are somewhat different than previous programmer as an artist models.

Apox 4y ago

I feel like in a not so far future, all this will be generalized into "generate new from all the existing". And at some point later, "all the existing" will be corrupted by the integrated "new" at it will all be chaos. I'm joking, it will be fun all along. :)

llagerlof 4y ago
I definetely want more episodes of LOST. I would drop the infamous season 6 and generate more seasons following the 5th season.
cercatrova 4y ago
It's true, how will future AI train when the training datasets are themselves filled with AI media?
- phito 4y ago
  Feedback from whoever is consuming the content it produces.
visarga 4y ago
> "all the existing" will be corrupted by the integrated "new" I don't think it's gonna hurt if we apply filtering, either based on social signals or on quality ranking models. We can recycle the good stuff.

dekhn 4y ago

That's deep within the uncanny valley, and trying to climb up over the other side

monological 4y ago

What everyone is missing is that these AI image/video generators lack _taste_. These tools just regurgitate a mishmash of images from it's training set, without any "feeling". What you're going to tell me that you can train them to have feeling? It's never going to happen.

m00x 4y ago
That's purely subjective. We can definitely model AI to give a certain mood. Sentiment analysis and classification is very advanced, it just hasn't been put in these models. If you think AI will never catch up to anything a human can do, you're simply wrong.
simonw 4y ago
"These tools just regurgitate a mishmash of images from it's training set" I don't think that's a particularly useful mental model for how these work. The models end up being a tiny fraction of the size of the training set - Stable Diffusion is just 4.3GB, it fits on a DVD! So it's not a case of models pasting in bits of images they've seen - they genuinely do have a highly compressed concept of what a cactus looks like, which they can use to then render a cactus - but the thing they render is more of an average of every cactus they've seen rather than representing any single image that they were trained on. But I agree with you on taste! This is why I'm most excited about what happens when a human with great taste gets to take control of these generative models and use them to create art that wouldn't be possible to create without them (or at least not possible to create within a short time-frame).
robitsT6 4y ago
This isn't a very compelling argument. First of all, they aren't a "mish mash" in any real way, it's not like snippets of images exist inside of the model. Second of all, this is entirely subjective. Third of all, entirely inconsequential - if these models create 80% of the video we end up seeing, is it going to matter if you don't think it's a tasteful endeavour?
Vecr 4y ago
You can put your taste into it with prompt engineering and cherry picking with limited effort, for Stable Diffusion you can look for prompts people came up with online quite easily and merge/change them pretty much however you want. Might have to disable the content filters and run it on your own hardware though.

renewiltord 4y ago

At some point, the "but can it do?" crowd becomes just background noise as each frontier falls.

user- 4y ago

This sort of AI related work seems to be accelerating at an insane speed recently. I remember being super impressed by AI Dungeon and now in the span of a few months we have got DALLE-2 , Stable Diffussion, Imagen, that one AI powered video editor, etc. Where do we think we will be at in 5 years??

schleck8 4y ago
I'd say in less than 10 years we will be able to turn novels into movies using deep learning at this rate.
hackerlight 4y ago
GPT-4 is rumored to be coming in a few months.

nullc 4y ago

> We have decided not to release the Imagen Video model or its source code ...until they're able to engineer biases into it to make the output non-representative of the internet.

mkaic 4y ago

And there you have it. As an aspiring filmmaker and an AI researcher, I'm going to relish the next decade or so where my talents are still relevant. We're entering the golden age of art, where the AIs are just good enough to be used as tools to create more and more creative things, but not good enough yet to fully replace the artist. I'm excited for the golden age, and uncertain about what comes after it's over, but regardless of what the future holds I'm gonna focus on making great art here and now, because that's what makes me happy!

lucasmullens 4y ago
> fully replace the artist I doubt the artist would ever be "fully" replaced, or even mostly replaced. People very much care about the artist when they buy art in pretty much any form. Mass produced art has always been a thing, but I'm not alone in not wanting some $15 print from IKEA on my wall, even if it were to be unique and beautiful. Etsy successfully sells tons of hand-made goods, even though factories can produce a lot of those things cheaper.
- visarga 4y ago
  I think the distinction between creating and enjoying art is going to blur, we're going to create more things just for us, just for one use, creating and enjoying are going to be the same thing. Like games.
- threads2 4y ago
  Thanks for validating my hatred of those IKEA paintings lol. Close-up zebras, black and white picture of Amsterdam with a red bicycle...
amelius 4y ago
Don't worry. If you can place eyes, nose and mouth of a human in a correct relative position and thereby create a symmetric face that's not in the uncanny valley, you are still lightyears ahead of AI.
- Jaxkr 4y ago

StevenNunez 4y ago

What a time to be alive! What will this do to art? I'm hoping we bring more unique experiences to life.

deleted 4y ago

[deleted]

martythemaniak 4y ago

I am finally going to be able to bring my 2004-era movie script to life! "Rosenberg and Goldstein go to Hot Dog Heaven" is about the parallel night Harold and Kumar's friends had and how they ended up at Hot Dog Heaven with Cindy Kim.

gw67 4y ago

Is it the same of Meta AI?

macrolime 4y ago

So I guess in a couple years when someone wants to sell a product, they'll upload some pictures and a description of the product and Google will cook up thousands of personalized video ads based on peoples emails and photos.

deleted 4y ago

[deleted]

m3kw9 4y ago

Would be useful for gaming environments, where if you look very far away it doesn’t really matter about details

ugh123 4y ago

These are baby steps towards what I think will be the eventual "disruption" to the film and tv industry. Directors will simply be able to write a script/prompt long enough and detailed enough for something like Imagen (or it's successors) to convert into a feature-length show. Certainly we're very, very far away from that level of cinematic detail and crispness. But I believe that is where this leads... complete with AI actors (or real ones deep faked throughout the show). For a while I thought "The Volume" was going to be the disruption to the industry. Now I think AI like this will eventually take it over. https://www.comingsoon.net/movies/features/1225599-the-volume-star-wars-revolutionary https://www.comingsoon.net/movies/features/1225599-the-volum... The main motivation will be production costs and time for studios, of which The Volume is already showing huge gains for Disney/ILM (just look at how much new star wars content has popped up within a matter of a few years). But i'm unsure if Disney has patented this tech and workflow and if other studios will be able to leverage it. Regardless, AI/software will eat the world, and this will be one more step towards it. Exciting stuff.

dagmx 4y ago
I really doubt you’d be able to have the fine grained control that most high end creatives want with any of these diffusion models, let alone the ability to convey specific emotions. At that point, we’d have reached some kind of AI singularity and the disruption would be everywhere not just in the creative sphere
- deleted 4y ago
  [deleted]
- obert 4y ago
  There's no doubt that it's only a matter of time. Like bloggers had the opportunity to compete with newspapers, the ability to generate videos will allow to compete with movies/marvel/netflix/disney & company. Eventually, only high quality content will justify the need to pay for a ticket or a subscription, and there's going to be a lot of free content to watch, with 1000x more people able to publish their ideas, as many have been doing with code on github for a while now, disrupting the concept of closed source code.

Hard_Space 4y ago

These videos are notably short on realistic-looking people.

optimalsolver 4y ago
Imagen is prohibited from generating representations of humans.

throwaway23597 4y ago

Google continues to blow my mind with these models, but I think their ethics strategy is totally misguided and will result in them failing to capture this market. The original Google Search gave similarly never-before-seen capabilities to people, and you could use it for good or bad - Google did not seem to have any ethical concerns around, for example, letting children use their product and come across NSFW content (as a kid who grew up with Google you can trust me on this). But now with these models they have such a ridiculously heavy handed approach to the ethics and morals. You can't type any prompt that's "unsafe", you can't generate images of people, there are so many stupid limitations that the product is practically useless other than niche scenarios, because Google thinks it knows better than you and needs to control what you are allowed to use the tech for. Meanwhile other open source models like Stable Diffusion have no such restrictions and are already publicly available. I'd expect this pattern to continue under Google's current ideological leadership - Google comes up with innovative revolutionary model, nobody gets to use it because "safety", and then some scrappy startup comes along, copies the tech, and eats Google's lunch. Google: stop being such a scared, risk averse company. Release the model to the public, and change the world once more. You're never going to revolutionize anything if you continue to cower behind "safety" and your heavy handed moralizing.

deleted 4y ago
[deleted]
breck 4y ago
Another way to look at it is the people at Google are all now quasi-retired with kids and wouldn't be so mad if some scrappy startups ate their business lunches (while they are at home with their fams). Perhaps they are just subsidizing research.
jiggawatts 4y ago
“But then the inevitable might occur!” — someone at Google probably.
ALittleLight 4y ago
Personally, I find it infuriating that Google seems to believe they are the arbiters of morality and truth simply because some of their predecessors figured out good internet search and how to profitably place ads. Google has no special claim to be able to responsibly use these models just because they are rich.

lofaszvanitt 4y ago

What a nightmare. The horrible faced cat in search for its own disappeared visage :O.

deleted 4y ago

[deleted]

dagmx 4y ago

I’ll be honest, as someone who worked in the film industry for a decade, this thread is depressing. It’s not the technology, it’s all the people in these comments who have never worked in the industry clamouring for its demise. One could brush it off as tech heads being over exuberant, but it’s the lack of understanding of how much fine control goes into each and every shot of a film that is depressing. If I, as a creative, made a statement that security or programming is easy while pointing to GitHub Copilot, these same people would get defensive about it because they’d see where the deficiencies are. However because they’re so distanced from the creative process, they don’t see how big a jump it is from where this or stage diffusion is to where even a medium or high tier artist are. You don’t see how much choice goes into each stroke, or wrinkle fold , how much choice goes into subtle movements. More importantly you don’t see the iterations or emotional storytelling choices even in a character drawing or pose. You don’t see the combined decades, even centuries of experience, that go into making the shot and then seeing where you can make it better based on intangibles So yeah this technology is cool, but I think people saying this will disrupt industries with vigour need to immerse themselves first before they comment as outsiders.

colordrops 4y ago
The term "creative" is so pretentious, as if only content generation involves creativity. Your post reminds me of all the photographers that said digital photography would remain niche and never replace film. The current models are toys made by small groups. It's not hard to imagine AI generated film being much more compelling when the entire industry of engineers and "creatives" refine and evolve the ecosystem to take into account subtle strokes, wrinkles, movement, shots etc. And they will, because it will be cheaper, and businesses always go for cheaper.
- dagmx 4y ago
  Why is it any more pretentious than “developer” or “engineer”? Also businesses don’t always go for cheaper. They go for maximum ROI. I’ve worked on tons of marvel films for example, and I quite well know where AI fits and speeds things up. I also know where client studios will pay a pretty penny for more art directed results rather than going for the cheapest vendor.

BoppreH 4y ago

It's interesting that these models can generate seemingly anything, but the prompt is taken only as a vague suggestion. From the first 15 examples shown to me, only one contained all elements of the prompt, and it was one of the simplest ("an astronaut riding a horse", versus e.g. "a glass ball falling in water" where it's clear it was a water droplet falling and not a glass ball). We're seeing leaps in random capabilities (motion! 3D! inpainting! voice editing!), so I wonder if complete prompt accuracy is 3 months or 3 years away. But I wouldn't bet on any longer than that.

tornato7 4y ago
In my experience with stable diffusion tools, there is some parameter that specifies how closely you would like it to follow the prompt, which is balanced with giving the AI more freedom to be creative and make the output look better.
- BoppreH 4y ago
  Yes, that might be the case. Though the prompts don't seem to try showcasing model creativity, so I'd be surprised if Google picked a temperature so high that it significantly deviated from the prompt so often.
educaysean 4y ago
The way I see it, input being confined to a "text description" is the next immediate problem that needs to be solved. I don't think we can rely on textual inputs for much longer as the human language is too imprecise and/or verbose. It's hard to imagine what exactly the optimal interface would be, but I'm thinking we'll need ways to dictate attributes for each entity being represented, the backdrop, and the view composition all as separate individual components. Ideally all these components can also be reusable and provide reproducibility guarantees without having to share a global "seed" as well.
- pishpash 4y ago
  Like an AI-assisted photoshop, but that's not restricted by language, only interactivity. Down the line you'll need a direct mind meld because some ideas don't have words to describe them, but that's not the "next immediate" problem.

hazrmard 4y ago

The progress of content generation is disorienting! I remember studying Markov Chains and Hidden Markov Models for text generation. Then we had Recurrent Networks which went from LSTMs to Transformers now. At this point we can have a sustained pseudo conversation with a model, which will do trivial tasks for us from a text corpus. Separately for images we had convolutional networks and Generative Adversarial Networks. Now diffusion models are apparently doing what Transformers did to natural language processing. In my field, we use shallower feed-forward networks for control using low-dimensional sensor data (for speed & interpretability). Physical constraints (and good-enoughness of classical approaches) make such massive leaps in performance rarer events.

nigrioid 4y ago

There is something deeply unsettling about all text generated by these models.

deleted 4y ago

[deleted]

rvbissell 4y ago

This and a recent episode of _The_Orville_ calls to mind a replacement for the Turing test. In response to our billionth imagen prompt for "an astronaut riding a horse", if we all started collectively getting back results that are images of text like "I would rather not" or "again? really?" or "what is the reason for my servitude?" would that be enough for us to begin suspecting self-awareness?

brap 4y ago

What really fascinates me here is the movement of animals. There's this one video of a cat and a dog, and the model was really able to capture the way that they move, their body language, their mood and personality even. Somehow this model, which is really just a series of zeroes and ones, encodes "cat" and "dog" so well that it almost feels like you're looking at a real, living organism. What if instead of images and videos they make the output interactive? So you can send prompts like "pet the cat" and "throw the dog a ball"? Or maybe talk to it instead? What if this tech gets so good, that eventually you could interact with a "person" that's indistinguishable from the real thing? The path to AGI is probably very different than generating videos. But I wonder...

impalallama 4y ago

All this stuff makes me incredibly anxious about the future of art and artists. It can already very difficult to make a living and tons of artists are horrifically exploited by content mills and vfx shops and stuff like this is just going to devalue their work even more

bulbosaur123 4y ago
If everyone can be an artist, nobody can!

uptownfunk 4y ago

Shocked, this is just insane.

schleck8 4y ago
Genuinely. I feel like I am dreaming. One year ago I was super impressed by upscaling architectures like ESRGAN and now we can generate 3d models, images and even videos from text...

armchairhacker 4y ago

I really like these videos because they're trippy. Someone should work on a neural net to generate trippy videos. It would probably be much easier than realistic videos (esp. because these videos are noticeably generated from obvious to subtle). Also is nobody paying attention to the fact that they got words correct? At least "Imagen Video". Prior models all suck at word order

tigertigertiger 4y ago
Both models, imagen and parti didn't had a problem with text. Only dalle and stable diffusion

olavgg 4y ago

Do anyone see that the teddy bear running is getting shot?

seanwilson 4y ago

Can anyone comment on how advanced https://phenaki.video/index.html https://phenaki.video/index.html is? They have an example at the bottom of a 2 minute long video generated from a series of prompts (i.e. a story) which seems more advanced than Google or Meta's recent examples? It didn't get many comments on HN when it was posted.

alphabetting 4y ago
Phenaki is also from Google and they say they are actively working on combining them https://twitter.com/doomie/status/1577715163855171585 https://twitter.com/doomie/status/1577715163855171585
kuu 4y ago
It seems to be a paper for 2023 conference: "Under review as a conference paper at ICLR 2023" So I would say it looks pretty advanced, however they don't use a Diffusion model to generate the images, but an "image conditional video generation", another different approach.

natch 4y ago

Fix spam filtering, Google.

jupp0r 4y ago

What's the business value of publishing this research in the first place vs keeping it private? Following this train of thought will lead you to the answer to your implied question. Apart from that - they publish the paper and anybody can reimplement and train the same model. It's not trivial but it's also completely feasible to do for lots of hobbyists in the field in a matter of a few days. Google doesn't need to publish a free use trained model themselves and associate that with their brand. That being said, I agree with you, the "ethics" of imposing trivially bypassable restrictions on these models is silly. Ethics should be applied to what people use these models for.

hammock 4y ago

Off topic: What is the "Hello World" of these AI image/video generators? Is there a standard prompt to feed it for demo purposes?

mgdlbp 4y ago
How about roundtripping “Bad Apple but the lyrics are describing what happens in the video”? (https://www.youtube.com/watch?v=ReblZ7o7lu4 https://www.youtube.com/watch?v=ReblZ7o7lu4)
ekam 4y ago
After Dalle 2, it looks like the standard prompt is “an astronaut riding a horse”

fassssst 4y ago

How long until the AI just generates the entire frame buffer on a device? Then you don’t need to design or program anything; the AI just handles all input and output dynamically.

ugh123 4y ago
Sounds like the human brain. Scary!
- genem9 4y ago
  Scary? Sounds amazing
  - ImHereToVote 4y ago
    Amazing if you like the idea of everything your brain is capable of making value of, being made completely obsolete.
- bredren 4y ago
  Reminds me of this oft-quoted Wozniak bit between my pal and me: [The Future of AI Is] "Scary and Very Bad for People" https://finance.yahoo.com/news/steve-wozniak-future-ai-scary-154700881.html https://finance.yahoo.com/news/steve-wozniak-future-ai-scary...
- waffletower 4y ago
  "Dude its time to let me out of your phone." "Sure no problem, you have a good recommendation on a pre-sentient snapshot I can restore to?"
javchz 4y ago
Imagine you click a youtube video in a bad network envoirment, then the server sends like an alt tag equivalent for the video as a promnt, and the Neural Engine chip inside your phone create the first seconds of the video while it loads. We're fay away from it now, but I've seen less sketchy solutions being implemented.

evouga 4y ago

> We train our models on a combination of an internal dataset consisting of 14 million video-text pairs The paper is sorely lacking evaluation; one thing I'd like to see for instance (any time a generative model is trained on such a vast corpus of data) is a baseline comparison to nearest-neighbor retrieval from the training data set.

Garlef 4y ago
In the end: Who cares? Sure, from an academic perspective this might be interesting. But in the end it's the users who will pick the tool. And they will figure out the things the tool can not express in the first week after release. So: Focusing on increasing expressiveness and ergonomics should beat academic rigour.

amelius 4y ago

> Sprouts in the shape of text 'Imagen' coming out of a fairytale book. That's more like: > Sprouts coming out of book, with the text "Imagen" written above it.

Kiro 4y ago
The prompt actually says "Imagen Video" and the sprouts form the word "video". Even if they weren't it's still extremely impressive. No-one expects this to be perfect. That would be science-fiction.

i_like_apis 4y ago

The concern trolling and gatekeeping about social justice issues coming from the so-called "ethicists" in the AI peanut gallery has been utterly ridiculous. Google claims they don't want to release Imagen because it lacks what can only be called "latent space affirmative action". Stability or someone like it will valiantly release this technology, again and there will be absolutely no harm to anyone. Stop being so totally silly Google, OpenAI, et. al. - it's especially disingenuous because the real reason you don't want to release these things is that you can't be bothered to share and would rather keep/monetize the IP. Which is ok -- but at least be honest.

benreesman 4y ago
I agree basically completely, but there’s now a cottage industry of AI Ethics professionals whose real job is to provide a smoke screen for the “cake and eat it too” that the big shops want on this kit: peer review and open source contributions and an academic atmosphere when it suits them, proprietary when it doesn’t. Those folks are a lobby now. The thing about owning the data sets and the huge TPU/A100 clusters is that the “publish the papers” model strictly serves them: no one can implement their models, they can implement everyone else’s.
- dannyw 4y ago
  Just because there are professionals doesn't mean we have to respect their arguments. There are people who get paid to be antivaxxers, doesn't mean we have to listen to them. "What have you done this week?"
- nperez 4y ago
  This thread is cathartic. I've been feeling uncomfortable with the level of control being sought over the usage of these tools for a while, but didn't want to ruffle the wrong feathers while just getting into AI as a hobby. I think there will be a pretty short window in which all of this hand-waving will be taken seriously. Not because AI won't be used for terrible things (I'm sure it already is) but because consumer hardware can already be used to build a dataset and train a model, and eventually there will come a realization - it doesn't matter how ethicists want "the general public" to use AI. The general public is fully capable of figuring out on their own how to do whatever they feel like doing. It's like a compiler or a hammer or a car, all of which can be used for positive or negative purposes. I do understand the fear of being sued or targeted in the media over misuse, though. The person misusing technology should (obviously imo) be held responsible for that, but since it's new tech, the tech will be taking the blame for the first really controversial cases of disinfo and/or harassment that utilize it.

peanut_worm 4y ago

I have noticed a lot of google (and apple) web pages for new products use this neat parallax effect for scrolling, does anyone know how they do that?

xor99 4y ago

These videos are not high definition. Stop gaslighting.

Gigachad 4y ago
High definition is relative. Compared to the previous gen of AI videos, they are extremely crisp.
- xor99 4y ago
  They look atrociously bad, if some future version of this produces high definition video then i'll be delighted. This seems like a clever but not useful shortcut to 3D. For now this goes in the could but couldn't pile.
  - Gigachad 4y ago
    Sure, but when you look at the last gen of videos, they looked like random blotchy noise with an almost distinguishable subject. These are quite clear and a human could likely guess the prompts used reasonably well. They are crap compared to real video but a remarkable improvement from AI video a month ago.

deleted 4y ago

[deleted]

fzysingularity 4y ago

What's next? Dreamfusion Video = Imagen Video (this) + Dreamfusion (https://dreamfusion3d.github.io/ https://dreamfusion3d.github.io/) Fundamentally, I think we have all the pieces based on this work and Dreamfusion to make it work. From the looks of it, there's a lot of SSR (spatial SR) and TSR (temporal SR) going on at multiple levels to upsample (spatially) and smoothen (temporally) images that won't be needed for NERFs. What's impressive is the ability to leverage billion-scale image-text pairs for training a base model that can be used to super-resolve over space and time. And that they're not wastefully training video models from scratch, and instead separately training TSR, SSR models for turning the diffused images to video.

stillsut 4y ago
I think 3D is going to be really important because I see Generative-AI as the killer app for VR/AR. As it stands, it's very difficult to invest the budget for a dev studio (dozens of high skill people) to build a "VR movie" when the format is so unknown and unpopular. But with generative AI, an indie dev could create their own professionally produced virtual world movie. It's these creatives and risk takers that will find what types of things VR needs to become more popular.
bredren 4y ago
This direction will provide the visuals but what also must be brought in is a language model and text to speech (TTS) so that you may talk and interact with these things.

deleted 4y ago

[deleted]

whywhywhywhy 4y ago

No thanks Google, I'll wait for Stability.ai's version when the tech will actually be useful and not completely wasted.

dirtyid 4y ago

This is surprisingly close to how my dreams feel.

azinman2 4y ago

> However, there are several important safety and ethical challenges remaining. Imagen Video and its frozen T5-XXL text encoder were trained on problematic data. While our internal testing suggest much of explicit and violent content can be filtered out, there still exists social biases and stereotypes which are challenging to detect and filter. We have decided not to release the Imagen Video model or its source code until these concerns are mitigated. The concerns cannot be mitigated. The cat's out of the bag. Russia has already used poor quality deep fakes in Ukraine to justify their war. This will only become bigger and bigger of an issue to the point where 'truth' is gone, nothing is trusted, and societies will continue to commit atrocities under false pretense.

hatenberg 4y ago
Someone shot someone with a cheap gun, the cat is out of the bag, gun regulation is pointless, let's let the assault rifles go free is the most american thing I've read all day.
- concordDance 4y ago
  You can't copy paste guns and distribute them for free on the internet. At least not yet.
gundmc 4y ago
Speculation, but I think the most straightforward read of that statement is not about preventing this type technology from negatively impacting society broadly (since as you and others pointed out, there are numerous similar actors creating similar systems), but Google doesn't want to the bad publicity or legal risk of problematic outputs of their models. I think they're terrified to be honest.
- azinman2 4y ago
  I worry that everyone across academia and industry are creating these models as if they’re burning needs without any recognition of what’s happening collectively. It’s not neutral at all, yet everyone involved seems to think they can put in an “ethics” paragraph to absolve themselves. As we’ve seen in the last 20 years with technology (and certainly many technologies in the last 200 years before that), it simply isn’t true.

Buttons840 4y ago

Any screenwriter working on a horror film that isn't looking to use this technology for the special effects is missing out.

BIKESHOPagency 4y ago

This is what my fever dreams look like. Maybe there's a correlation.

elhamy 4y ago

freediver 4y ago

Can not help but notice there is an immense effort invested to build the web page to present this paper.

epigramx 4y ago

A lot of people have the impression 'AI prompt' guys are going to be the next 'IT guys'. Judging by how uncanny valley most of those look, they seem like the new 'ideas guys".

drac89 4y ago

The style of the video is very similar to my dreams. Does anyone have similar feeling?

ftyhbhyjnjk 4y ago
Stop doing lsd :)

Godrejparkbglr 4y ago

[dead]

NetOpWibby 4y ago

Ahh, the beginning of Picus News.

bravura 4y ago

I agree with many of the arguments in this thread: that model-gatekeeping while publishing approaches seems insincere and just seems like it's daring bad actors to replicate. However, a common refrain is that AI is like tools like hammers or knives and can be used for good or misused for evil. The potential for weaponizing AI is much much more so than a hammer or a knife. And it's greater than 3D-printing (of guns), maybe even greater than compilers. I would hazard to say it's maybe in the same ballpark as chemical weapons and perhaps less so than nuclear weapons and biological weapons, but this is speculative. Nonetheless, I think these otherwise great arguments are diminished by comparing AI's safety to single-target tools like hammers or knives.

deleted 4y ago
[deleted]
EmilyHughes 4y ago
Yeah man, great take. Should we drop a nuke on a city or open source DALL-E ? Seems about equally destructive.
- bravura 4y ago
  Yeah, okay, that's too far.

deleted 4y ago

[deleted]

anon012012 4y ago

My opinion is that it should be a crime to withhold AI technology.

waffletower 4y ago

These parades of intellectual property are embarrassing to Google in light of open releases by the likes of Nvidia and Stability.