11 ms·
Gemini Omni
- clapthewind 5mo agoI think Hollywood is in for a rough era. The disruption is happening at break neck speeds.
- advisedwang 5mo agoAt the moment the duration of each shot is a major limitation. When that limitation gets solved is when we'll see actual disruption.
- boredhedgehog 5mo agoAverage shot length is down to something like 3 seconds in modern cinema. That's a pretty low bar.
- franze 5mo agoAt one point the only way to know if something is real or by a major US tech company is nudity.
- andrewstuart 5mo agoHollywood is already in a rough era but it’s because they can’t create original human stories any more. This tech won’t change anything.
- mrandish 5mo agoYeah, during most blockbuster movies lately all I can think is: "All pixels, no plot."
- nomel 5mo agoProject Hail Mary was largely real sets and a puppet.
- Insanity 5mo agoThey used a puppet to play Rocky? Was not sure how they did it, don’t think I would really care, but that’s cool.
- mrandish 5mo agoThey used a puppet on-set for in-camera reference but most of what you saw on-screen in most shots was CGI. I wrote more here: https://news.ycombinator.com/item?id=48198851 https://news.ycombinator.com/item?id=48198851
- tencentshill 5mo agoWas it? Hollywood has been caught lying about that to seem more authentic before. https://www.redsharknews.com/why-do-movies-still-insist-there-is-no-cgi-in-their-shots https://www.redsharknews.com/why-do-movies-still-insist-ther...
- dymk 5mo agoThere are tons of behind the scenes pictures and video of the Rocky puppet being used on set, and Andy Weir talks in interviews about how almost no CG was used to enhance the puppet. I guess it's possible to fake all that, but it's a lot of lie to cover up.
- mrandish 5mo agoAndy Weir is a wonderful novelist and was truthfully relating his understanding but he's not a VFX person. I didn't see the quote you did but he probably confused the fact that PHM used physical elements in place of some CGI in certain scenes and the separate fact that a realistic physical puppet was used on set for reference. Some parts of that puppet are seen on-screen in some shots but most of the creature in most shots was CGI or CG enhanced (which looked great thanks to the ideal in-camera puppet reference it replaced). I explained more here: https://news.ycombinator.com/item?id=48198851 https://news.ycombinator.com/item?id=48198851
- 5mo ago
- wcxcv 5mo agoTheres a Steve Jobs quote about this
- mackeye 5mo agoyou would watch a movie generated with the sterility of an LLM?
- garciasn 5mo agoSure; why not? It has to be better than some of the absolute garbage that's out on the various streaming services today; right?
- yojo 5mo agoMe? No. My kids? I think they already have. I don’t allow YouTube in our house, but they for sure watch slop with friends.
- nomel 5mo agoAI is already in a bunch of creative workflows. Just look at modern Photoshop. Selecting and hitting delete has AI infill for the background replacement. Creates can these video gen AI in various ways. There are some youtube channels of people using these in creative workflows that are really impressive, from mocap replacement, character insertion, background replacement, changing camera angle in post, animating/inserting characters from character boards, animated between stills generated in traditional methods, etc. It's not just "prompt and generate". It can be, because it's easy, but it also doesn't have to be. It's a tool.
- mackeye 5mo agoi do photo restoration as part of my research (bizarre place to be for a math undergrad), so i do think AI is a lifesaver for very small adjustments that would be tedious or subpar otherwise. i just disagree that its creative output is of value (which isn't the case you made, anyway).
- jarjoura 5mo agoHollywood is using this tech already. Storyboarding and previs work has already fully become driven by AI tools.
- meetpateltech 5mo agoblog post: https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-omni/ https://blog.google/innovation-and-ai/models-and-research/ge... model card: https://deepmind.google/models/model-cards/gemini-omni-flash/ https://deepmind.google/models/model-cards/gemini-omni-flash...
- franze 5mo ago> I can create more videos as soon as your limit resets. Check your usage in Settings I did not create any videos yet. Google, building great AI that nobody can try out. But thx for the press release.
- andrewstuart 5mo agoGoogle often does this - they show it off and forget to give it to you.
- tristanb 5mo agoMe too - awesome job.
- throw03172019 5mo agoBrowser crashes while scrolling because of all the auto playing videos. Please use IntersectionObserver to pause the video when not in display.
- nicce 5mo agoSounds like someone would use LLM to make it and no single human has reviewed
- SoKamil 5mo agoSafari?
- Foomf 5mo agoIt keeps crashing my browser as well. I'm on Microsoft Edge.
- zarzavat 5mo agoSame in Mobile Safari.
- fuzzy2 5mo agoOn my iPad Pro from 2017, none of the videos even play. Not sure what's better!
- SyneRyder 5mo agoNot to negate your experience, but seems fine on Firefox 150 on my Windows ThinkPad X1.
- dsign 5mo agoSo it's really good, and we have reason to believe, never again, anything that happens in a video. Unless there's a super-product somewhere to authenticate footage?
- svieira 5mo agoNow that they've broken the ability to trust video, they're looking to build it back, as long as you're allowed to use the tools: https://blog.google/innovation-and-ai/products/identifying-ai-generated-media-online/ https://blog.google/innovation-and-ai/products/identifying-a... (and the previous SynthID: https://deepmind.google/blog/identifying-ai-generated-images-with-synthid/ https://deepmind.google/blog/identifying-ai-generated-images...) But it very much is "close the barn door after the horse has bolted and the barn has otherwise burned down".
- spogbiper 5mo agoIt seems like this super-product will have to be a thing soon or we will have to just stop using video evidence in court and other critical applications
- adenta 5mo agoAt first usage I'm not impressed. I've probably spent a couple grand on Seedance 2 to date, and I can't find anything google omni flash does better than Seedance from running a handful of samples through the system. You can find some of the videos I've made in my HN bio link.
- red2awn 5mo agoI have exactly the same thought. Anyone who had used seedance 2.0 a bit can tell Gemini is a bit behind, and seedance 2.1 is on the horizontal already.
- kamranjon 5mo agoJust curious - are you at all concerned about the legal implications of ai-generating property listing videos?
- layer8 5mo agoThe legal risk probably lies solely with those who are selling the properties. They are responsible if the video misrepresents anything.
- raincole 5mo agoAt the bottom there is a "Try in Youtube Shorts" button. Oh god...
- kordlessagain 5mo agoPure artificial stupidity: https://www.youtube.com/watch?v=aRJH7HKuD2Y https://www.youtube.com/watch?v=aRJH7HKuD2Y
- darksim905 5mo agoyour videos and links re: nuts services are very cool. Is that something you're working on with others? What's the best way to keep on top of that?
- entropicdrifter 5mo ago[flagged]
- dyauspitr 5mo agoYes, each data center uses an entire lake of water. The hysterics are pretty sad and baseless. Have you ever considered that the solution to not having enough power is to generate more power, not curtail progress? All of these data center should come with their own solar panel arrays and battery packs. Who knows with enough need they might each come with their own small nuclear reactor.
- entropicdrifter 5mo ago[dead]
- tsco77 5mo agoThen, if the Ai bubble is truly a bubble, the giant compute warehouses can be transitioned to power plants and used to store Amazon junk for delivery instead. Wonder what the economic wonkiness looks like when energy is that abundant.
- andrewstuart 5mo agoWho is creative enough to drive this in any meaningful way? Certainly not me - you have to be a great artist /designer to even imagine what to do with it.
- mrandish 5mo agoBack in 90s during the first wave of the desktop video revolution when desktop editing became possible and consumer camcorders got pretty good, there was a popular marketing slogan: "Now your imagination is the only limit." I used to joke that was the moment we discovered "for most people that's a pretty big limit."
- enragedcacti 5mo ago> Prompt: Make it look like the weird shape of my hand hole super zooms and magnifies the ground it's looking at in sharper quality. There's got to be a reason this is phrased so insanely, right?
- layer8 5mo agoImage-search for “hand hole” at your own peril.
- bar94 5mo agoEven weirder: > Prompt: A skeuomorphism stop motion explainer about how the brain hippocampus works with a compelling voiceover. Don’t add seahorses. No voice cuts at the end. Don’t add text Seahorses???
- gfaure 5mo agoThe genus of the seahorse is _Hippocampus_.
- incognito124 5mo agoThis guy prompts. Insanely astute.
- svieira 5mo agoAnd the fact that a transformer model can't distinguish between the two in the context of the sentence given is a point against the general nature of the intelligence.
- Geee 5mo agoWe are at the point where "don't add seahorses" doesn't actually fill it with seahorses like the previous models.
- FrostKiwi 5mo agoThe goblins evolved it seems
- kenjackson 5mo agoI'm an AI optimist. But AI video is probably the one thing that does depress me. Seeing that we can make anything visually, there's nothing that impresses me visually. I watch a video that two years ago I would've thought was really cool, and now my first thought is, "Yawn, is this AI?". Video, more than anything else, is the place where I really care if something is AI or not. If I could get a TikTok that had no AI usage -- I'd be in. Which is weird for me, because I'm typically the guy who is all-in on AI.
- raincole 5mo agoIt ruined the whole category of "cute animals acting goofy" content for sure.
- slfnflctd 5mo agoYeah, I'm kinda sad about that one. Most of my friends and family are aware many of these are fake now, but argue that it still invokes the same response in us so it's okay. For me, though, however intangible or irrational it may be, I do feel a sense of loss. Funny enough, this is actually one of the few things which has bothered me with the AI boom, and I'm mostly pro-acceleration. A lot of what's happening seems inevitable. But surprisingly, knowing that cat or dog or bird or lizard or butterfly or whatever has a strong chance of being generated really does take something out of it to my mind. And I say that also knowing the extreme amount of staging which has long gone on with traditional nature videography. Somehow, knowing the animal is real means something... I'm still trying to figure out how to better understand and express this.
- Vachyas 5mo agoIn addition, even knowing it's not real, I feel like I can't appreciate it as much as I did (or would've) a well-made clip that I knew was CGI.
- sleno 5mo agoIt's not all bad: https://www.tiktok.com/@openchub/video/7641631412407274782 https://www.tiktok.com/@openchub/video/7641631412407274782
- manas96 5mo agoIn my day job I program rigid body behaviour in real time amongst other simulations. I think rigid body contact is hard to learn as it is inherently discontinuous.. something you discover when trying to code a solver. As such I always use this prompt as a test: "A video of a jenga brick tower falling over as a brick is removed. The physics of each brick must be realistic." It gave me a video of where bricks suddenly disapper or morph into others[1]. The linked video is after 2-3 iterations of me insisting on realistic physics. If you are just glancing at this, you would believe it is realistic. That said this is still very impressive and one more step towards .. IDK what. But I am a bit reasurred that at least my job won't be fully replaced with AI :) [1] https://streamable.com/2em1r3 https://streamable.com/2em1r3
- nine_k 5mo agoSuch videos are essentially dreams: how it feels that the planks should move, not what equations of rigid body physics would compute. And the feeling is realistic (even if overly dramatic in the end). If "stylistic transfer" works for static pictures spread out in space, why won't it work for the character of motion spread out in time?
- darkwater 5mo agoI wonder what's the training data that makes it generate the final "explosion"...
- jddj 5mo agoA little too much Michael Bay
- tiahura 5mo agoI was thinking eleven.
- badsectoracula 5mo agoThe physics engine glitching is very realistic :-P
- baq 5mo agoWe could be solving fusion power and instead we’re generating videos of birds in space or something. The market is a harsh mistress sometimes.
- dwa3592 5mo agoEven though I don't have words to express how impressive this capability looks. I am genuinely scared at the harmful use cases of this.
- uejfiweun 5mo agoDoes anyone else feel like Google is just always a dollar short and a day late here? Maybe not a dollar short, but it's like they've consistently been focused on the wrong thing. First they missed chatbots, now they're missing coding agents while they double down on chatbots and video gen (which OpenAI has already basically abandoned). Maybe this strategy is actually genius and I'm too stupid to grasp it.
- jarjoura 5mo agoNano Banana Pro is still the industry standard as far as I’m concerned. I think giving a vision model spatial awareness is the next evolutionary step here, so I don’t think they’re behind at all.
- torginus 5mo agoWhile at a cursory glance it looks as impressive as always, subtle spatial errors, and geometry that changes as it goes out of sight and comes back again hints at the fact that Google has still yet to solve the problem of deep spatial understanding. Which considering just how pretty and detailed this whole thing looks, imo points at a fundamental issue at how these things are trained - it's as if there's no structure to its knowledge and training, like how an artist trained to draw would first try to understand simple 2d composition, then perspective, then light and shadow, mastering each concept and gradually building up a hierarchical understanding - it seems like its trying to learn everything at once. I would rather see an AI model that I could give a floorplan of a building and it would generate an accurate flythrough on any path, even if it looked like butt. Im not just talking out of my arse, I did work for a while in data science/engineering, and one of the big lessons people needed to be reminded of is to clean/downsample the data - a dataset consisting of a million samples could very well take 1000x as long to process as if we downsampled the whole thing to just a couple of thousand samples and we could learn the same conclusions with the fraction of expended time/effort. I'm sure there's a similar logic in RL, that if you dump a trillion samples into the datacenter that consumes the same power as a city, what the model learns is what it could've learned with a much more curated training set and directed approaches.
- amelius 5mo agoWhat I'm hoping/waiting for is IMDB users creating alternative endings of movies. It could make the comments section even more fun.
- blt 5mo agoIt's funny how they specifically use the phrase "output that follows real-world physics" to describe the marble rolling video. At the end of the zigzag track, the marble jumps up for no reason. In a couple of other places it speeds up with no apparent energy source. It's still an amazing result, but they could have picked a better example for this claim!
- deleted 5mo ago[deleted]
- nl 5mo agoInterestingly the `o` in GPT-o4 stood for Omni too (which I never realized until yesterday when reading random 3rd party documentation)
- randomthoughts5 5mo agothis is omni pro max
- az226 5mo agohttps://media1.giphy.com/media/SxB0S9MgHo4ZoNrDRk/200w.gif https://media1.giphy.com/media/SxB0S9MgHo4ZoNrDRk/200w.gif
- deleted 5mo ago[deleted]
- King-Aaron 5mo agoThe people that think this output looks good are the same people that "don't get" art. From a technical perspective, it's very impressive, no doubt. But from an artistic perspective I thought all of these examples on the site look bad.
- kermatt 5mo ago> I can create more videos as soon as your limit resets. Check your usage in Settings. I have not used Gemini in a month.
- vldszn 5mo agoWhen I click the link, the website crashes on my iPhone 13 iOS Chrome lol
- randomthoughts5 5mo agoWhat's the end goal of video generation? It feels unnecessary. Text generation leads to AI that can replace workers. Video generation is bad and only for video content generation, like movie and tv show production?
- jackson_mile 5mo agoTo be honest, I think the performance of Gemini Omni Flash is still not as good as Seedance 2.0. You can try using both models on this platform. https://omnivideoai.co https://omnivideoai.co
- LZ_Khan 5mo agoThis model is very misunderstood. It's not good at raw generation, but it has really deep world knowledge. Not just knowledge of physics, but just knowledge in general. There are examples like providing a basic google maps view and then asking it to simulate driving from point A to point B, and it will generate landmarks from that location. It's also great at consistency and editing. Probably SotA in editing. Not sure what use cases will be unlocked but I sense something is there.