4 ms·
I got access to the preview, here's what it gave me for "A pelican riding a bicycle along a coastal path overlooking a harbor" - this video has all four version
by simonw 2y ago
I got access to the preview, here's what it gave me for "A pelican riding a bicycle along a coastal path overlooking a harbor" - this video has all four versions shown:
https://static.simonwillison.net/static/2024/pelicans-on-bicycles-veo2.mp4 https://static.simonwillison.net/static/2024/pelicans-on-bic...
Of the four two were a pelican riding a bicycle. One was a pelican just running along the road, one was a pelican perched on a stationary bicycle, and one had the pelican wearing a weird sort of pelican bicycle helmet.
All four were better than what I got from Sora: https://simonwillison.net/2024/Dec/9/sora/ https://simonwillison.net/2024/Dec/9/sora/
- AgentME 2y agoIt's funny having looked forward to Sora for a while and then seeing it be superseded so shortly after access to it is finally made public.
- rob74 2y agoWell yeah, if you look closely at the example videos on the site, one of them is not quite right either: > Prompt: The sun rises slowly behind a perfectly plated breakfast scene. Thick, golden maple syrup pours in slow motion over a stack of fluffy pancakes, each one releasing a soft, warm steam cloud. A close-up of crispy bacon sizzles, sending tiny embers of golden grease into the air. [...] In the video, the bacon is unceremoniously slapped onto the pancakes, while the prompt sounds like it was intended to be a separate shot, with the bacon still in the pan? Or, alternatively, everything described in the prompt should have been on the table at the same time? So, yet again: AI produces impressive results, but it rarely does exactly what you wanted it to do...
- soco 2y agoTechnically speaking I'd say your expectation is definitely not laid out in the prompt, so anything goes. Believe me I've had such requirements from users and me as a mere human programmer am never quite sure what they actually want. So I take guesses just like the AI (because simply asking doesn't bring you very far, you must always show something) and take it from there. In other words, if AI works like me, I can pack my stuff already.
- tim333 2y agoHere's one of a penguin paragliding and it's surprisingly realistic https://x.com/Plinz/status/1868885955597549624 https://x.com/Plinz/status/1868885955597549624
- 0_____0 2y agoThis is the first GenAI video to produce an "oh shit" reflex in me. oh, shit!
- jillyboel 2y agoThis tech is cute but the only viable outcomes are going to be porn and mass produced slop that'll be uninteresting before it's even created. Why even bother?
- bottled_poe 2y agoComments like this one are so predictable and incredulous. As if the current state of the art is the final form of this technology. This is just getting started. Big facepalm.
- ferguu_ 2y agoI hope they're right. If the technology improves to such a degree that meaningful content can be produced then it could spell global disaster for a number of reasons. Also I just don't want to live in a world where the things we watch just aren't real. I want to be able to trust what I see, and see the human-ness in it. I'm aware that these things can co-exist, but I'm also becoming increasingly aware that as long as this technology is available and in development, it will be used for deception.
- jnwatson 2y agoThat ship sailed shortly after the invention of photography. Photos were altered for political purposes during the US Civil War. Now, we have entire TV shows shot on green screen in virtual sets. Replacing all the actors is just the next logical step.
- deleted 2y ago[deleted]
- ferguu_ 2y agoThat's exactly what I mean, all of those methods take some human effort, there is a human involved in the process. Now we face a reality that it might take no human effort to do... well, anything. Which is terrifying to me. I do believe that humans are restless, and even when there is no longer any point to create, and it is far easier to dictate, we still will, just because we are too driven not to.
- grumbel 2y agoI am surprised that the top/right one still shows a cut and switch to a difference scene. I would assume that that's something that could be trivially filtered out of the training data, as those discontinuities don't seem to be useful for either these short 6sec video segments or for getting an understanding of the real world.
- oneshtein 2y agoHere is my version of pelican at bicycle made with hailuoai: https://hailuoai.video/share/N9dlRd1L1o0p https://hailuoai.video/share/N9dlRd1L1o0p
- victorbjorklund 2y agoThat is surprisingly good. We are at a point where it seems to be good enough for at least b-roll content replacing stock video clips.
- nkingsy 2y agoHis little bike helmet is adorable
- mckirk 2y agoThe AI safety team was really proud of that one.
- p1necone 2y agoAs long as at least one option is exactly what you asked for throwing variations at you that don't conform to 100% of your prompt seems like it could be useful if it gives the model leeway to improve the output in other aspects.
- jerpint 2y agoIt looks much better than Sora but still kind of in uncanny valley
- spaceman_2020 2y agoThis is the worst it will ever be…
- yurylifshits 2y agoThere's another important contender in the space: Hunyuan model from Tencent My company (Nim) is hosting Hunyuan model, so here's a quick test (first attempt) at "pelican riding a bycicle" via Hunyuan on Nim: https://nim.video/explore/OGs4EM3MIpW8 https://nim.video/explore/OGs4EM3MIpW8 I think it's as good, if not better than Sora / Veo
- dr_kiszonka 2y agoReddit says it is much better than Sora. Are you hosting the full version of Nunyuan? (Your video looks great.)
- yurylifshits 2y agoOur limited tests show that yes, Hunyuan is comparable or better than Sora on most prompts. Very promising model
- echelon 2y agoHunYuan is also open source / source available unless you have 100M DAU. Then there's Lightricks LTX-1 model and Genmo's Mochi-1. Even the research CogVideoX is making progress. Open source video AI is just getting started, but it's off to a strong start.
- prometheon1 2y agoIs it still better if you copy his whole prompt instead of half of it?
- chrismorgan 2y ago> A whimsical pelican, adorned in oversized sunglasses and a vibrant, patterned scarf, gracefully balances on a vintage bicycle, its sleek feathers glistening in the sunlight. As it pedals joyfully down a scenic coastal path, colorful wildflowers sway gently in the breeze, and azure waves crash rhythmically against the shore. The pelican occasionally flaps its wings, adding a playful touch to its enchanting ride. In the distance, a serene sunset bathes the landscape in warm hues, while seagulls glide gracefully overhead, celebrating this delightful and lighthearted adventure of a pelican enjoying a carefree day on two wheels. What does it produce for “A pelican riding a bicycle along a coastal path overlooking a harbor”? Or, what do Sora and Veo produce for your verbose prompt?