14 ms·
Gaussian Splatting – A$AP Rocky "Helicopter" music video
https://www.youtube.com/watch?v=g1-46Nu3HxQ https://www.youtube.com/watch?v=g1-46Nu3HxQ
- nodra 10mo agoNever did I think I would ever see anything close to related to A$AP on HN. I love this place.
- keiferski 10mo agoHah, for the past day, I've been trying to somehow submit the Helicopter music video / album as a whole to HN. Glad someone figured out the angle was Gaussian.
- stickfigure 10mo agoIs he wearing... hair curlers?
- nodra 10mo agoThat's what one does when they want some fiyah curls.
- wahnfrieden 10mo agoAnd nearly a Carti post at the top of HN
- rw_panic0_0 10mo agoI'm taking the opportunity to FWAEH in here
- portly 10mo agoWhat do you mean?
- wahnfrieden 10mo agoHelicopter had a Carti feature that was pulled but leaked, and a promo photoshoot with the two of them for it.
- 47thpresident 10mo agoOne day we’ll see a an Osamason or Xaviersobased post on HN
- blonddd 10mo agoNo fucking way have I just seen Osamason and Xav mentioned on HN
- HaZeust 10mo agor/playboicarti is one of my favorite places to go to just turn my brain off and see shitposts that have a certain reminiscence to me, almost a "high school class when the teacher didn't show up" vibe.
- wahnfrieden 10mo ago95% of its posters are in high school or lower, and are in class during daytime hours, so that's a part of why it makes you feel like that
- HaZeust 10mo agoIndeed. It's a good vibe when you want to turn your brain off sometimes though, same reason why Beavis and Butthead succeeds and is re-aired.
- erratic_chargi 10mo agoBro the day I see Carti on HN is the day I'm leaving this site, some things shouldn't mix
- joshcsimmons 10mo agoWhy is that “cool” or desirable?
- amazingman 10mo agoBecause expertise, love, and care cut across all human endeavor, and noticing those things across domains can be a life affirming kind of shared experience.
- shikshake 10mo agoPerfect comment, but it’s very funny to me that you even needed to say it. Some folks on here talk like moon people who have never met humans before.
- joshcsimmons 10mo agoThanks I’m neurodivergent how could you tell?
- shikshake 10mo agoSo am I, but I don’t use it as an excuse to put down other’s interests.
- HaZeust 10mo agoFavorited. This will be a timeless comment for me, and will remind some perspective to appreciate things I might not be otherwise familiar with, and thereby care about.
- nodra 10mo agoDesirable because it’s a rare culture + tooling combo. I’m into both and HN is one of the few places I would see them come together. So yeah, “cool”
- throwadobe 10mo ago
- callbacked 10mo agoyeah that had me do a double take lol
- PlatoIsADisease 10mo agoI run a programming company and one of my sales people was surprised to see I liked soundcloud rap. I was like: What did you expect? >Classical music? Nah I like hype, helps when things are slow.
- m4ck_ 10mo agoProkofiev's Alexander Nevsky goes hard if you do want something in the classical world though.
- gopher_space 10mo agoDoctor Octagon’s “moose bumps” iirc.
- elestor 10mo agoI know right? I'm into both things tech and hip hop, didn't expect them to collide
- daveofiveo 10mo agoDirect link to the music video: https://www.youtube.com/watch?v=g1-46Nu3HxQ https://www.youtube.com/watch?v=g1-46Nu3HxQ
- dang 10mo agoGood idea - we'll put that link in the toptext as well. Thanks!
- roughly 10mo agoBe sure to watch the video itself* - it’s really a great piece of work. The energy is frenetic and it’s got this beautiful balance of surrealism from the effects and groundedness from the human performances. * (Mute it if you don’t like the music, just like the rest of us will if you complain about the music)
- filoleg 10mo agoSimilarly, the music video for Taylor Swif[0] (another track by A$AP Rocky) is just as surrealistic and weird in the best way possible, but with an eastern european flavor of it (which is obviously intentional and makes sense, given the filming location and being very on-the-nose with the theme). 0. https://youtu.be/5URefVYaJrA https://youtu.be/5URefVYaJrA
- roughly 10mo agoHoly shit that’s great. I need to check a few more of his videos.
- owlninja 10mo agoA$AP Rocky has always put out interesting videos, here are a few others that are pretty cool: Yamborghini high: https://www.youtube.com/watch?v=tt7gP_IW-1w https://www.youtube.com/watch?v=tt7gP_IW-1w L$D: https://www.youtube.com/watch?v=Gx4JEBwVlXo https://www.youtube.com/watch?v=Gx4JEBwVlXo
- prmoustache 10mo agoI can see how this kind of videos can attract the tiktok addicts with less than 3 seconds of attention time. I wonder what will be the state of cinema/series/video clips in 30 years? Will singers/rappers give up sentences completely and just mention names of emojis? Will we have to use screens at 576hz to be able to watch acclerated videos without seeing a constant blur? I guess most kids from today would fall asleep before the end of the generic of Twin Peaks or the opening scene of Fargo.
- yieldcrv 10mo agoso basically despite the higher resource requirements like 10TB of data for 30 minutes of footage, the compositing is so much faster and more flexible and those resources can be deleted or moved to long term storage in the cloud very quickly and the project can move on fascinating I wouldn't have normally read this and watched the video, but my Claude sessions were already executing a plan the tl;dr is that all the actors were scanned in a 3D point cloud system and then "NeRF"'d which means to extrapolate any missing data about their transposed 3D model this was then more easily placed into the video than trying to compose and place 2D actors layer by layer
- andybak 10mo ago> and then "NeRF"'d which means to extrapolate any missing data about their transposed 3D model Not sure if it's you or the original article but that's a slightly misleading summary of NeRFs.
- yieldcrv 10mo agoI'm all for the better summary
- darhodester 10mo agoGaussian splatting is not NeRF (neural radiance field), but it is a type of radiance field, and supports novel view synthesis. The difference is in an explicit point cloud representation (Gaussian splatting), versus a process that needs to be inferred by a neural network.
- IshKebab 10mo agoIt's not a type of radiance field.
- michaelrubloff 10mo agoIt’s literally the name of gaussian splatting. 3D Gaussian Splatting for Real Time Radiance Fields https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/ https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/
- rjh29 10mo agoTo be honest it looks like it was rendered in an old version of Unreal Engine. That may be an intentional choice - I wonder how realistic guassian splatting can look? Can you redo lights, shadows, remove or move parts of the scene, while preserving the original fidelity and realism? The way TV/movie production is going (record 100s of hours of footage from multiple angles and edit it all in post) I wonder if this is the end state. Gaussian splatting for the humans and green screens for the rest?
- moi2388 10mo agoYes, they talk about this in the article and that’s exactly what they did.
- rjh29 10mo agoIt wasn't clear to me how much this was intentional vs. being the limits of the technology at the moment.
- cubefox 10mo agoI guess the technology still has some quality limitations, otherwise we would already see it in mainstream movies, e.g. to simulate smooth camera motions beyond what is achievable with video stabilization. It's much more difficult to achieve 4K quality that holds up on a movie theater screen, without visible artifacts, than to do an artistic music video.
- jofzar 10mo agohttps://youtu.be/eyAVWH61R8E?t=3m53s https://youtu.be/eyAVWH61R8E?t=3m53s I would say Superman's quality didn't suffer for it. I would say cost is probably the most expensive part it's also just like "why bother", it's not CG, it's not "2d filming" so it's just niche, like the scenarios you would actually need this are very low.
- cubefox 10mo ago
- noman-land 10mo agoReally amazing video. Unfortunately this article is like 60% over my head. Regardless, I actually love reading jargon-filled statements like this that are totally normal to the initiated but are completely inscrutable to outsiders. "That data was then brought into Houdini, where the post production team used CG Nomads GSOPs for manipulation and sequencing, and OTOY’s OctaneRender for final rendering. Thanks to this combination, the production team was also able to relight the splats."
- darhodester 10mo agoHi, I'm one of the creators of GSOPs for SideFX Houdini. The gist is that Gaussian splats can replicate reality quite effectively with many 3D ellipsoids (stored as a type of point cloud). Houdini is software that excels at manipulating vast numbers of points, and renderers (such as Octane) can now leverage this type of data to integrate with traditional computer graphics primitives, lights, and techniques.
- deleted 10mo ago[deleted]
- suzzer99 10mo agoCan you put "Gaussing splats" in some kind of real world metaphor so I can understand what it means? Either that or explain why "Gaussian" and why "splat". I am vaguely aware of stuff like Gaussian blur on Photoshop. But I never really knew what it does.
- darhodester 10mo agoSure! Gaussian splatting is a bit like photogrammetry. That is, you can record video or take photos of an object or environment from many angles and reproduce it in 3D. Gaussians have the capability to "fade" their opacity based on a Gaussian distribution. This allows them to blend together in a seamless fashion. The splatting process is achieved by using gradient descent from each camera/image pair to optimize these ellipsoids (Gaussians) such that the reproduce the original inputs as closely as possible. Given enough imagery and sufficient camera alignment, performed using Structure from Motion, you can faithfully reproduce the entire space. Read more here: https://towardsdatascience.com/a-comprehensive-overview-of-gaussian-splatting-e7d570081362/ https://towardsdatascience.com/a-comprehensive-overview-of-g....
- pleurotus 10mo agoSuper cool to read but can someone eli5 what Gaussian splatting is (and/or radiance fields?) specifically to how the article talks about it finally being "mature enough"? What's changed that this is now possible?
- rkuykendall-com 10mo agoI found this VFX breakdown of the recent Superman movie to have a great explanation of what it is and what it makes possible: https://youtu.be/eyAVWH61R8E?t=232 https://youtu.be/eyAVWH61R8E?t=232 tl;dr eli5: Instead of capturing spots of color as they would appear to a camera, they capture spots of color and where they exist in the world. By combining multiple cameras doing this, you can make a 3D works from footage that you can then zoom a virtual camera round.
- deleted 10mo ago[deleted]
- michaelrubloff 10mo agoI also spoke to the vfx team from Superman on how they achieved the reconstructions! (I’m also the author for the Helicopter article here). https://radiancefields.com/gaussian-splatting-in-superman https://radiancefields.com/gaussian-splatting-in-superman
- djeastm 10mo agoFor the ELI5, Gaussian splatting represents the scene as millions of tiny, blurry colored blobs in 3D space and renders by quickly "splatting" them onto the screen, making it much faster than computing an image by querying a neural net model like radiance fields. I'm not up on how things have changed recently
- tel 10mo agoGaussian splatting is a way to record 3-dimensional video. You capture a scene from many angles simultaneously and then combine all of those into a single representation. Ideally, that representation is good enough that you can then, post-production, simulate camera angles you didn't originally record. For example, the camera orbits around the performers in this music video are difficult to imagine in real space. Even if you could pull it off using robotic motion control arms, it would require that the entire choreography is fixed in place before filming. This video clearly takes advantage of being able to direct whatever camera motion the artist wanted in the 3d virtual space of the final composed scene. To do this, the representation needs to estimate the radiance field, i.e. the amount and color of light visible at every point in your 3d volume, viewed from every angle. It's not possible to do this at high resolution by breaking that space up into voxels, those scale badly, O(n^3). You could attempt to guess at some mesh geometry and paint textures on to it compatible with the camera views, but that's difficult to automate. Gaussian splatting estimates these radiance fields by assuming that the radiance is build from millions of fuzzy, colored balls positioned, stretched, and rotated in space. These are the Gaussian splats. Once you have that representation, constructing a novel camera angle is as simple as positioning and angling your virtual camera and then recording the colors and positions of all the splats that are visible. It turns out that this approach is pretty amenable to techniques similar to modern deep learning. You basically train the positions/shapes/rotations of the splats via gradient descent. It's mostly been explored in research labs but lately production-oriented tools have been built for popular 3d motion graphics tools like Houdini, making it more available.
- londons_explore 10mo agoPretty sure most of this could be filmed with a camera drone and preprogrammed flight path... Did the Gaussian splatting actually make it any cheaper? Especially considering that it needed 50+ fixed camera angles to splat properly, and extensive post-processing work both computationally and human labour, a camera drone just seems easier.
- ex-aws-dude 10mo agoI think you’re missing the point Volumetric capture like this allows you to decide on the camera angles in post-production
- echelon 10mo agoIt's fucking cool. That's why. This tech is moving along at breakneck pace and now we're all talking about it. A drone video wouldn't have done that.
- ThouYS 10mo agoit gives you flexibility, options
- larsmaxfield 10mo agoFlying a camera drone with such proximity and acceleration would be a safety nightmare.
- nebezb 10mo agoIf it was achievable, cheaper, and of equal quality then it would have been done that way. Surely it would’ve been done that way a long time ago too. Drone paths have been around a lot longer than this technology. There’s no proof of your claim and this video is proof of the opposite.
- darhodester 10mo agoA drone path would not allow for such seamless transitions, never mind the planning required to nail all that choreography, effects, etc. This approach is 100% flexible, and I'm sure at least part of the magic came from the process of play and experimentation in post.
- drdirk 10mo agoCan somebody explain to me what was actually scanned? Only the actors doing movements like push ups, or whole scenes / rooms?
- MuffinFlavored 10mo agoHow did Rhianna look him in the eyes and say "yes babe, good album, release it, this is what the people wanted after 7 years, it is pleasing to listen to and enjoyable"?
- larsmaxfield 10mo agoI prefer when artists make music they intrinsically want to make — not what others want them to make.
- b00ty4breakfast 10mo agothe real question is how much of the art is their own and how much is outside expectations and their reactions to it. And it's not always giving in to those voices, sometimes it's going in the opposite direction specifically to subvert those voices and expectations even if that ends up going against your initial instincts as an artist. With someone like A$AP Rocky, there is a lot of money on the line wrt the record execs but even small indie artists playing to only a hundred people a night have to contend with audience expectation and how that can exert an influence on their creativity.
- perfmode 10mo agoIt seems the numerous leaks and trials took their toll. I don’t disagree with you—I felt “Tailor Swif,” “DMB,” and “Both Eyes Closed” were all stronger than the tracks that made it onto this album. But sometimes you’ve gotta ship the project in the state it’s in and move on with your life. Maybe now he can move forward and start working on something new. And perhaps that project will be stronger.
- weakfish 10mo agoBecause it was awesome. But also, leaks probably.
- delbronski 10mo agoIm sure it was more like, “hey babe, can I get a few millions to go in the studio and experiment/make some art?” And then she was like, “yeah go for it! Make some weird shit.” If I was in his position I’d probably be doing the same. Why bother with another top hit that pleases the masses.
- sneak 10mo ago> One recurring reaction to the video has been confusion. Viewers assume the imagery is AI-generated. According to Evercoast, that couldn’t be further from the truth. Every stunt, every swing, every fall was physically performed and captured in real space. What makes it feel synthetic is the freedom volumetric capture affords. No, it’s simply the framerate.
- moribvndvs 10mo agoIn another setting, it looks like ass, but lo-fi, glitchy shit is perfectly compatible with hip-hop aesthetic. Good track though.
- henshao 10mo agoI think in 2026 it's hard to make a video look this "bad" without it being a clear aesthetic choice, so not sure you could find this video in another setting.
- ungreased0675 10mo agoThe technology is impressive, but the end result… Weapons-grade brainrot. I’m curious what other artists end up making with it.
- F7F7F7 10mo agoThe article said it was by design...
- SamBam 10mo agoI really disagree with the label brainrot. Brainrot is low-quality garbage with no artistic merit, and very little thought behind its creation, which does nothing but make you briefly pause while scrolling, before scrolling away with no lasting impression being done to your mind (besides increased boredom and inability to focus). This is clearly an artistic statement, whether you like the art or not. A ton of thought and time was put into it. And people will likely be thinking and discussing this video for some time to come.
- ungreased0675 10mo agoI think I have a different definition of brainrot than you. I think of attention grabbing visuals that have no meaning, just something to keep your eyes glued to the screen. A good example are those Subway Surfers split screen videos, where someone is babbling about nothing in one frame, but the visuals in the other keep people watching. Another example is AI-narrated “news” on YouTube. Nobody would normally listen to an AI voice read AI slop, but if there are some extreme video clips quickly switching every few seconds, people don’t immediately click away. Brain rot shreds the attention span and uses all kinds of psychological tricks to keep people engaged. In the Helicopter video, every second is packed with visual information, not to contribute to the narrative but to capture attention. The backgrounds are full of details. The camera never stops moving. The subjects depicted are even attention grabbing: police lights, dancing people, guns, car crashes, flamethrowers! Hey, does that guy have pink curlers in his hair? It’s not that I don’t like it (I kinda do), but a media diet of that kind of content is bad for the brain.
- darhodester 10mo agoHi, I'm David Rhodes, Co-founder of CG Nomads, developer of GSOPs (Gaussian Splatting Operators) for SideFX Houdini. GSOPs was used in combination with OTOY OctaneRender to produce this music video. If you're interested in the technology and its capabilities, learn more at https://www.cgnomads.com/ https://www.cgnomads.com/ or AMA. Try GSOPs yourself: https://github.com/cgnomads/GSOPs https://github.com/cgnomads/GSOPs (example content included).
- chrisjj 10mo ago[flagged]
- deleted 10mo ago[deleted]
- darhodester 10mo agoThat's hurtful.
- dagmx 10mo agoIs it possible you didn’t comprehend which parts were 3D? Or if you did, perhaps a critique is better rather than just a low effort diss.
- chrisjj 10mo agoI viewed on a flat monitor, so perhaps I missed some 4D and 5D too. /i
- sbierwagen 10mo agoFrom the article: >Evercoast deployed a 56 camera RGB-D array Do you know which depth cameras they used?
- brcmthrowaway 10mo agoKinect Azure
- narrator 10mo agoThis reminds me about how Soulja Boy just used a cracked copy of Fruity Loops and a cheap microphone and recorded all his songs that made him millions.[1] Edit: Ok this was a big team of VFX producers who did this. Still, prices are coming down dramatically in general, but yeah that idea is a bit of an underfit to this case. [1] https://www.youtube.com/watch?v=f1rjhVe59ek https://www.youtube.com/watch?v=f1rjhVe59ek
- comradesmith 10mo agoI really don’t see the connection. A$AP isn’t a noob
- deleted 10mo ago[deleted]
- enneff 10mo agoYou might consider why this article which has nothing to do with AI as you know it (except for the machine learning aspects of Gaussian splatting), and was produced by a huge team of vfx professionals, has made you think about AI democratising culture (despite the fact that music videos and films have been cheap to make for decades). Don’t just look for opportunities to discuss your favourite talking points.
- narrator 10mo agoFair point actually. touché.
- jojobas 10mo agoThe whole rap/hip-hop scene got jump-started by 1977 NYC blackout electronics store lootings.
- jtolmar 10mo agoDang, it's been cool watching gaussian splats go from tech demo to real workflow.
- darhodester 10mo agoFor sure!
- deleted 10mo ago[deleted]
- weinzierl 10mo ago"The team also used Blender heavily for layout and previs, converting splat sequences into lightweight proxy caches for scene planning."
- badcryptobitch 10mo agoBoth of my worlds are colliding with this article. I love reading about how deeply technical products/artifacts get used in art.
- KevinMS 10mo agoaren't music videos supposed to have music?
- hahahahhaah 10mo agoit does, it just doesn't have video
- lawgimenez 10mo agoA$AP Rocky’s music videos has been always great.
- diffuse_l 10mo agoToo bad, but I managed to watch about 30 seconds of the video before getting motion sickness. Seems like a really cool technology, though. I wonder if anyone else got the same response, or it's just me.
- lwhi 10mo agoI loved the video. Didn't get the motion sickness myself.
- darhodester 10mo agoMy wife said the same thing, but it gets better after the intro.
- mikkupikku 10mo agoSame. It's very cool but left me badly motion sick.
- andy99 10mo agoYes, just clicked on the video, instantly nauseous. I get motion sick generally.
- squidsoup 10mo agoTangential, but I've been exploring gaussian splatting as a photographic/artistic medium for a while, and love the expressionistic quality of the model output when deprived of data. https://bayardrandel.com/gaussographs/ https://bayardrandel.com/gaussographs/
- darhodester 10mo agoCool aesthetic!
- kroaton 10mo agoLoving this; great work! Do you talk about the process anywhere in more depth?
- squidsoup 10mo agoThanks! I'm using the KIRI Engine in Blender to render splats from my photos (https://github.com/Kiri-Innovation/3dgs-render-blender-addon https://github.com/Kiri-Innovation/3dgs-render-blender-addon) and then process the image as I would my photography in Lightroom. There are lots of different photogrammetry tools for generating plys (the point cloud) like PolyCam (https://poly.cam https://poly.cam).
- HugoDz 10mo agoVery cool!
- ablation 10mo agoA very cool aesthetic and application of technology, thank you for sharing.
- squidsoup 10mo agothank you!
- Footprint0521 10mo agoThey really said it’s capturing everything when A$AP Rocky’s Gaussian splatted mouth in that video be looking worse than AI generated video lol
- darig 10mo ago[dead]
- periodjet 10mo agoThe end result is really interesting. As others have pointed out, it looks sort of like it was rendered by an early 2000s game engine. There’s a cohesiveness to the art direction that you just can’t get from green screens and the like. In service of some of the worst music made by human brains, but still really cool tech.
- millitzer 10mo agoYou could also pull a Michel Gondry and do it with practical effects. https://www.youtube.com/watch?v=s5FyfQDO5g0&list=RDs5FyfQDO5g0&start_radio=1 https://www.youtube.com/watch?v=s5FyfQDO5g0&list=RDs5FyfQDO5...
- Foreignborn 10mo agoI want to shoutout Nial Ashley (aka Llainwire) for doing this in 2023 as a solo act and doing the visuals himself as well - https://www.youtube.com/watch?v=M1ZXg5wVoUU https://www.youtube.com/watch?v=M1ZXg5wVoUU A shame that kid was slept on. Allegedly (according to discord) he abandoned this because so many artists reached out to have him do this style of mv, instead of wanting to collaborate on music.
- killjoywashere 10mo agoYou're saying Nial used guassian splatting for his video? Or the style of camerawork, staging, and costuming is similar? Put another way, is this a scientific comparison or an artistic comparison?
- mlrtime 10mo agoIt sounds like to me he [artist] was disappointed that more people were interested in his video editing than his musical efforts.
- Hendrikto 10mo ago> so many artists reached out to have him do this style of mv, instead of wanting to collaborate on music Well yes, the visuals are awesome, while the music… isn’t.
- Foreignborn 10mo agoI love HN because everyone is so different outside of the core purpose of the site. Sometimes people reference art, or a book or something, that I'd never would think to exist. Llainwire was my top artist listens throughout 2023, so it’s always funny to bump into reactions that feel totally different from my world/my peers.
- prodigycorp 10mo agoThis is sooo sick. I’m a total hip hop unc and haven’t caught up for a decade and a half now and I think the music is great as well. Pairs perfectly with the visuals. Hope this guy makes it, a creative one of one. His stuff is already on repeat. Thanks for the recc, love this site.
- renewiltord 10mo agoWow, back to music videos. It’s been years. This is a great one.
- tokymegz 10mo agoHello! I’m Chris Rutledge, the post EP / cg supervisor at Grin Machine. Happy to answer any questions. Glad people are enjoying this video, was so fun to get to play with this technique and help break it into some mainstream production
- darhodester 10mo agoGrin Machine knocked this out of the park! Great job, Chris and crew!
- origamiarmy 10mo agoAwesome work, incredibly well done! What was the process like for setting the direction on use of these techniques with Rakim? Were you basically just trusted to make something great or did they have a lot of opinions on the technicalities?
- tokymegz 10mo agoI didn’t interface much with Rocky outside of the shoot, our director Dan was talking to him regularly and he certainly had options and great ideas but mostly left it up to us. All of the creative came from Dan and bouncing ideas off us / trying things and seeing what was possible with this tech. By the end of the process it was awesome to get Dan also into blender helping set up camera moves himself, in addition to finessing the edit and animatic to help point us in the right direction.
- iamleppert 10mo agoThe texture of Gaussian Splatting always looks off to me. It looks like the entire scene has been textured or has a bad, uniform film grain filter to me. Everything looks a little off in an unpleasing way -- things that should be sharp are aren't, and things that should be blurry are not. It's uncanny valley and not in a good way. I don't get what all the rage is about it and it always looks like really poor B-roll to me.
- jimbo808 10mo agoA$ap Rocky's music videos have some really good examples of how AI can be used creatively and not just to generate slop. My favorite is Taylor Swif, it's a super fun video to watch. https://www.youtube.com/watch?v=5URefVYaJrA https://www.youtube.com/watch?v=5URefVYaJrA
- Findecanor 10mo agoI can't really respect the artist though, after the assault on a random bystander in Stockholm in 2019 — for which he was convicted. He got off too easy. I would have refused to work on this.
- e9 10mo agoI was wondering how these kind of scenes were done in the movie Enter The Void back in 2009. Maybe they used different technique but looks very similar: https://vimeo.com/60239415 https://vimeo.com/60239415
- GrowingSideways 10mo agoThe splatting seems to be video only but I could be wrong. It's only a matter of time until the #1 hit figures out how to make this work
- nelkazzu 10mo agoIt’s interesting to see Gaussian splatting show up in a mainstream music video this quickly. A year ago it was mostly a research demo, and now artists are using it as part of their visual toolkit. What I find most notable is how well splats handle chaotic motion like helicopter shots — it’s one of the few 3D reconstruction methods that doesn’t completely fall apart with fast movement. Feels like we’re going to see a lot more of this in creative work before it shows up in anything “serious”.
- aidenn0 10mo agoMaybe I'm getting old, but I can't watch for more than about 5 seconds without getting a headache.
- firecall 10mo agoIt would be super cool if these articles or websites actually explained anywhere what volumetric capture and radiance fields actually are!
- karol 10mo agoThe rap seems rather derivative, lyrics contain mandatory token "pussy".
- defrost 10mo agoIt's a post about the visuals not the libretto. If you're looking for bars sans pussy, read on: https://www.youtube.com/watch?v=yKifJ4Q5ph0 https://www.youtube.com/watch?v=yKifJ4Q5ph0
- mikkupikku 10mo agoAll art is derivative. I don't care for this music, but being derivative isn't a real criticism.
- hackable_sand 10mo agoGood shit
- GuB-42 10mo ago> many viewers focused on the chaos, the motion, and the unmistakable early MTV energy of the piece It certainly moves around a lot! It certainly looks like the tech and art style here are indissociable. Not only the use of Gaussian Splats made such extreme camera movement possible, one can be argued that it made them necessary. Pause the video and notice the blurriness and general lack of details. But the frantic motion doesn't let the viewer focus on this details, most of them hidden by a copious amount of motion blur anyways. To me it is typical of demos, both as in the "demoscene" and "tech demo" sense, where the art style is driven by the technology, insisting on what it enables, while at the same time working around its shortcomings. I don't consider it a bad thing of course, it leads to a lot of creativity and interesting art styles.
- whizzter 10mo agoKinda, it all depends on platforms and eras. As a demoscener I see more of techdemo, indiedev and "game-mods" vibes in much of it (especially certain kinds of jankiness feel of visuals in some parts that demosceners doing more high end in general try to avoid but is more meme-worthy in game-mods/indiedev circles). Demos often aim for a bit more clean visuals (and palettes), blurriness is often tuned in another way. Sadly, much of the demoscene is in a bit of a navel-grazing retro computing phase, many active ones today are "returners" from the C64 and Amiga eras whilst PC sceners of the 90s either dropped off for money, games or kids. It's also the sheer work-effort, demoscene in the 90s and early 00s could focus on rendering while visual art pipelines didn't matter as much, as graphics cards got better it was obvious that the scene was falling behind the cutting edge games (both in asset due to workload and hacks required for graphics cards to render realistically). The introduction and early popularization of SDF rendering turned the scene a bit more relevant again, but it's also been masking a certain lack of good artists since programmers could create nice renderings without needing assets. However, to match something like this video in creativity would require a lot of asset workload (and non-trival rendering), and that combo is not really that common today sadly. Funnily enough, I was actually discussing just Gaussian Splatting as a solution for more "asset heavy" demos about a year ago with another scener friend, but sadly there's a tad of a stigma culturally as NN/"AI" methods has been fairly controversial within the scene, aside from programmers there are both visual and music artists, and among those camps it's not really a popular thing. It's still mostly a method though, and SDF rendering + GS could in the end be a saviour in disguise for the scene to go beyond just rendering and bring back a bit more story-telling to the scene.
- rubzah 10mo agoOh wow, somehow I was not aware of how capable this technology has become, looks like a major game changer, across many fields. In the near term, it could be very useful for sports replays. The UFC has this thing where they stitch together sequences of images from cameras all around the ring, to capture a few seconds of '360 degree' video of important moments. It looks horrible, this would be a huge improvement.
- profsummergig 10mo agoSo sad that nobody thought it important to ELI5 whatever on earth "gaussian splatting" means, and how it's different than regular splatting (if there's such a thing), or regular video. To me the video looks like the figures have slightly rounder edges, that's all.
- deleted 10mo ago[deleted]
- jofzar 10mo agoSay you have a photo, but you want to be able to explore it in 3d so you put it into fortnite but when you move you can't see behind objects because the photo never "saw" behind object. So you decide to take lots and lots of photos at every single angle possible, but you need a way to link these all together, so you decide that each Centrepoint of the image is a "gaussian". These splat everywhere. Now you have taken all of these photos and you can now explore the image in fortnite because you took thousands of images of every possible view! But what if you didn't want to just look at the frozen image in a landscape in fortnite, instead you wanted to use a man dancing in your new upcoming YouTube video called helicopter. If you isolate this person (let's say taking all these photos on a green screen) you now have a 3d like recording model, you can reshoot and "scene" on-top of something else (like a 3d diarama like in your video!)
- tomaytotomato 10mo agoSame, I found this video explainer here: https://www.youtube.com/watch?v=Tnij_xHEnXc https://www.youtube.com/watch?v=Tnij_xHEnXc Whenever I see Gaussian, I think of the Gauss gun from Half Life 2
- erratic_chargi 10mo agoFirst Rocky is a redditor now he on HN, this rollout is weird.
- nedjdkdkdk 10mo ago[dead]
- hbarka 10mo ago> Viewers assume the imagery is AI-generated. Watching this Helicopter music video made me recall a scene in Money for Nothing by Dire Straits, which was famously the first music video to air on MTV Europe (when the MTV phenomenon launched the 80s). It used 3D animation for the human characters and was considered groundbreaking animation in that time. The irony is we knew it was computer generated but now human generated is indistinguishable from AI.
- bininunez 10mo agoHello! I'm Ben Nunez, CEO at Evercoast. Our software was used to capture and reconstruct the 4D Gaussian splats in this A$AP Rocky video. The music video is a mix of creative and technical genius from several different teams, and it's ultimately a byproduct of building tooling to capture reality once and reuse it downstream. There’s a lot more to explore here. Once you have grounded 4D human motion and appearance tied to a stable world coordinate system, it becomes a missing primitive for things like world models, simulation, and embodied AI, where synthetic or purely parametric humans tend to break down.
- jeffsipko 10mo agoHi all! If you watched the video and thought you'd love to make stuff like that, but then you looked at the cost of a volumetric capture and nope'ed out, we should talk! I've been developing a solution to make the cost of 4D capture an order of magnitude cheaper by using a small number of off-the-shelf cameras. Here's the proof-of-concept demo using 4x GoPros: https://youtube.com/shorts/Y56l0FlLlAg https://youtube.com/shorts/Y56l0FlLlAg (yes, lots of room to improve quality). You can also see the interactive version (with XR support) at https://gaussplay.lovable.app https://gaussplay.lovable.app
- IndySun 10mo agoWhere does this tech originate, creatively? I'm especially thinking about a 1990s or 2000s Rolling Stones pop video that seemed to 'mess with time' but (by and large) in 2d. Had a 'drunk' look to it.
- Centigonal 10mo agoA$AP Mob has some really great music videos. They're usually not the first to adopt a new technology, but they love to push the envelope and popularize fringe techniques. The Yamborghini High music video from 2016 did some really cool stuff with datamoshing and hue shifting: https://www.youtube.com/watch?v=tt7gP_IW-1w https://www.youtube.com/watch?v=tt7gP_IW-1w