14 ms·
$100 AI Music Video: Claude Fable 5 vs. GPT-5.6 Sol
- curvaturearth 3mo agoThey're all pretty bad lol
- fortran77 3mo agoI hate AI slop as much as the next Hacker News reader, but I thought these were just fine. Any one of these would have thoroughly entertained me during the 80s MTV era.
- tolga-inkpilots 3mo agoWe still need a different approach to create this. Consistency is the problem in video, a model should create from start to end instead of different shots.
- zhinit 3mo agoSeems like if you build some more scaffolding around it, it wouldn't be bad. I think AI video isn't quite there yet so you probably would want to lean into that. For example you could ask for an animated or cartoon music video so the real shots don't look weird. Also if you gave it some guidance on what a good music video is like it would probably help as well. But yeah idk may be that's not the goal here.
- maerF0x0 3mo agoUnsure if it's just the way they prompted it / coded it, but the output is far too much a literal direct copy of the lyrics. The best music videos have a story arc on the theme of but often not litearlly the lyrics, and start with obscurity and reveal something (following all the literary/story mechanisms) Consider Amber Run - Found lyrics versus the video, and the story arc of the video https://www.youtube.com/watch?v=Yj6V_a1-EUA https://www.youtube.com/watch?v=Yj6V_a1-EUA
- anonova 3mo agoLiteral music videos are still fun and a valid creative direction, e.g., Vance Joy's "Riptide": https://www.youtube.com/watch?v=uJ_1HMAGb4k https://www.youtube.com/watch?v=uJ_1HMAGb4k
- Forgeties79 3mo agoThat’s not really the same thing.
- Waterluvian 3mo agoThe thing about art is that literally everything is a "valid creative direction." But that doesnt make everything immune from derision.
- NuclearPM 3mo agoI don’t understand what your point is.
- RIMR 3mo agoThe point is that, at least presently, an algorithm lacks the creativity to meaningfully stimulate an intellectual person, and whatever excuse you give for the decisions that algorithm makes, you should never expect a human being to be more impressed with the algorithm than they are with their human peers.
- little-victory 3mo ago[dead]
- therein 3mo agoCoincidence that both songs reference Michelle Pfeiffer or was that free connotation at work?
- titanomachy 3mo ago
- bubblegumcrisis 3mo agoWow. These are horrible. Sort of refreshing. I thought video was better than this now, but I guess not.
- fittestme 3mo agoExact same impression
- bgroins 3mo agoSlightly different impression
- Sohcahtoa82 3mo agoVideo can be good if you stick to a garden path of simple scenes with tons of examples in the training material and not a ton of motion between overlapping objects in a scene, and don't really care too much about specifics. As soon as you want something very specific, or something novel, or anything with a lot of moving objects/people, it falls apart.
- meric_ 3mo agoVideo is better. The models just chose older video models which are not SOTA
- apt-apt-apt-apt 3mo agoThese are getting really good. Much more interesting than the average music video already.
- nzoschke 3mo ago> None of the music videos were great Glad they acknowledge this. Curious how much time in addition to tokens this costs. If you have to spend $25 and wait 45 minutes to get a basically unwatchable video, I'm not worried about indie film makers being replaced just yet...
- qurren 3mo agoI'm classically trained and I honestly can't really tell how these are worse than the human produced ones. They all look kinda the same to me.
- beepbooptheory 3mo agoClassically trained in music videos??
- fragmede 3mo agoPresumably they went to college for it, yeah. Film schools, eg https://cinema.usc.edu/ https://cinema.usc.edu/ or https://tisch.nyu.edu/ https://tisch.nyu.edu/
- qurren 3mo agoNo, as in classical music. The analog kind.
- altcognito 3mo agoSo, how is that relevant to the part that is generated by AI?
- qurren 3mo agoI honestly can't tell a good music video from a bad one. I don't know what makes a music video "good". These AI generated ones seemed pretty good to me, of the same caliber as those Michael Jackson or "Beez in the trap" things. It's all just butt shaking and sunglasses in Philips Hue lights chanting some meaningless words.
- deleted 3mo ago[deleted]
- LPisGood 3mo agoRegular music videos (including the writing/recording) can easily go into 6 figures. I wonder what the $200,000 AI music videos looks like.
- echelon 3mo agoYou don't need to spend $200k, because results can be bad for cheap. https://youtu.be/HDdsKJl92H4 https://youtu.be/HDdsKJl92H4 Though we're finding the studios contracted to do this can bill $50k. I know several studios that previously billed clients six figures for ad campaigns (P&G, HBO, pharma, etc.) are now charging five figures and winning a lion share of the bids now. Not sure why Wan is the focus of this article and Seedance is a footnote. Wan/LTX/open models are significantly behind Chinese closed source models. (And the Chinese have left the Western models in the dust.) I wouldn't do anything production grade in Wan.
- janalsncm 3mo ago3 of the 4 agents used Wan, the other one used Seedance.
- lwkl 3mo agoBut why spend the same amount of money on AI instead of humans? My guess is that shooting a music video is probably fun for a lot of artists. And with AI the result is not predictable and might be inconsistent in the dumbest ways. My guess is that an AI music video would have to be a lot cheaper for artists to consider it outside of making one just because you want to make an AI music video.
- paulddraper 3mo agoOkay, then a $50,000 music video. The idea is to reduce production cost and therefore more plentiful/accessible.
- jrflowers 3mo agoExactly the same
- deleted 3mo ago[deleted]
- gausswho 3mo agoSkip the Claude Fable 5 $25 video to 1:42. The disembodied Adams' Family hand is on the job.
- siwakotisaurav 3mo agoAI videos as in remotion based videos look much better imo since it can code much better than it can prompt for videos with a coherent narrative https://youtu.be/uDAeAuYyl0E https://youtu.be/uDAeAuYyl0E (parody of Claude announcements) https://youtu.be/cSsVNtGPOIg https://youtu.be/cSsVNtGPOIg (recreating a fireship video)
- sushid 3mo agoThis is incredible! Did you make these yourself? I am familiar with remotion but this is a lot more than just splicing images, etc. Did you use a skill library to make this?
- siwakotisaurav 3mo agoYea this one specifically is mostly fable, remotion skills and allowing it to use Gemini 3.1 pro to understand the video The Claude one was a 3-prompt to get it to recreate the original “Agent view” announcement video. But wanted to challenge it, hence the bankruptcy mode. But it’s really bad at coming up with jokes and a coherent narrative so had to guide it wit prompts like 5 times or so Fireship video that was just a single prompt, with allowing it to use my basement gpu which has Higgs installed for the voice clone
- lwkl 3mo agoSo AI could generate a great lyrics video.
- Scubabear68 3mo agoIt is jarring to me that most of the dancing seems slightly out of sync with the music. It is like a music video uncanny valley - images look good, but the lack of sync to the sound shatters the illusion entirely.
- scotty79 3mo agoTo me nearly all of the real world dancing looks like that. The dancers could literally be olympic level and I still don't see the connection between their movements and the sounds of the music. Music videos sometimes do sync for me but only on very simple motions, and for whatever reason shuffle dance on video almost always looks great.
- datsci_est_2015 3mo agoHow many hours of your life would you say you’ve danced? Have you ever trained at a sport beyond the recreational level, especially highly rhythmic ones like basketball or soccer? Genuinely curious, because I have friends without any sense of rhythm and it’s interesting how it manifests
- scotty79 3mo ago> How many hours of your life would you say you’ve danced? I'd say less than 20? Maybe even less than that. Even counting short bursts, to especially compelling music, that did't last more than few seconds. The closest I ever felt, to what I imagine people might feel while dancing, was playing Beat Saber in VR. You could have your friends try, they might enjoy it. I did. I spent way more hours on Beat Saber than I ever spent dancing. But I don't see any improvement from that. > Have you ever trained at a sport beyond the recreational level, especially highly rhythmic ones like basketball or soccer? I don't think I ever did anything in my life beyond recreational level. Even coding feels recreational level regardless of how much I get paid. Basketball is completely incomprehensible for me. The rule that you can't do more than one step while holding the ball is impossible and unreadable when somebody else does it. Dribbling is pretty hard too. I played some soccer as a kid and at school but I wasn't good at this because of multiple factors. I mostly played defense when sometimes I could interrupt the attacking player mostly with a single action, not a sequence. I wouldn't even think about soccer as rhythmic sport, but I imagine it can be, if you are leading the ball which I pretty much never did successfully. I hate repeatable movements done during exercises. Never participated in any exercise groups (beyond what was enforced at school). I like biking but I vary my pedaling style a lot while riding and I don't ride for too long, few hours at most. I like walking but I zone out completely during walks. I can't run due to rapidly diminishing lung capacity when I try but I imagine if I could it would resemble walking. I don't play instruments and never had any success in that area. I can't do and don't enjoy trying souls like games. I'm not a fan of platformers with all the repeated jumping and timing their repeats to what happens in the level. From games that require skill I prefer (quake-like) FPPs. On the plus side, I have decent full body reflexes and rarely ever fall. In falls reliably instincitvely shield myself with arms to prevent damage to the head and mostly body. I can't imagine getting hurt by stepping on lego brick because my feet react to what I'm stepping on quickly shifting the load around any sharp or uneven objects. The brain itself is decent as well. I'm in top <1% according to Mensa iq test results. It feels like cyclical engine of my brain is very weak while the reactive one is fairly good.
- adverbly 3mo agoWhen the line was "don't believe me just watch" And then the clip was literally just an arm wearing a watch! That's freaking hilarious! It's like someone playing charades
- evan_ 3mo agothe giant cartoon dragon with a sign that says "retired" made me guffaw
- kerriy 3mo ago[dead]
- blueshoe 3mo agoThe fable $25 version was the best.
- kev009 3mo agoThe GPT ones are strange. The $25 fable one to me is subjectively better than the others. The $100 fable one is too literal and robotic. The jevons paradox is you need auteurs to curate vignettes or effects and cut or mask them in etc. That's not really different philosophically when software entered art in other ways. I could see errors/glitches lowering in time but I doubt there will be much acceleration.
- DrewADesign 3mo ago> need auteurs to curate vignettes or effects and cut or mask them in etc The problem is that reliable, repeatable professional-grade commercial art and design sensibilities happen in full-time careers. It’s entirely different than fine art, where intense self-exploration and experimentation are a very viable option. These tools are exacerbating an already difficult creative job market so there’s no reasonable path to get those skills. Our creative professional pipeline is fundamentally broken.
- kev009 3mo agoThe same thing is happening in software, I see the ladder pulled up and don't feel vulnerable as senior staff. If anything, we face a massive and increasing competency crisis in computing because there is a cult dumb enough to believe acceleration and doomer cases for LLMs.
- DrewADesign 3mo agoI got out of the software business after a couple decades and the market for newly graduated designers in my field collapsed in my senior year of 2024 so now I work in machining. The last of the core industrial skilled trade workforce that came up in the 70s and 80s, before offshoring, is retiring. Offshoring left the industry with all the skilled workers they needed for decades, so a vanishingly small number of apprentices were trained. Since the seniors transferred very little knowledge, very few people still have that knowledge, and they’re scrambling to transfer all of that knowledge into a new batch of apprentices. I think the software business is closer to a trade than an engineering profession than people care to admit, and is looking at something like that down the road a few years. In the interim, we can look to the rust belt to see how the America industry treats workers that are no longer needed. I don’t even think we need autonomous, agentic virtual developers to make that happen — a double-digit productivity boost will likely result in a double-digit job market contraction.
- angrydev 3mo agoWow. These are all terrible. Music video producers can breathe a sigh of relief.
- saaaaaam 3mo agoThese are awful. It’s like Suno music. Seems convincing if you half listen. As soon as you pay attention you notice all the cracks.
- thewanderer1983 3mo agoVisual effects went through this same development issues as the industry matured. What took this industry decades to advance it taking months in AI. Think the spaghetti Will Smith and now this. Another one people don't mention here but is specific to video is higgsfield ai.
- claaams 3mo agoThose old movies with old visual effects are watchable and still enjoyable. This is never good, interesting or enjoyable.
- KronisLV 3mo ago> Those old movies with old visual effects are watchable and still enjoyable. Id say it’s definitely possible to get spoiled by high production quality - if I went back to the old Star Trek or even the first seasons of the Doctor Who reboot, I’d mostly have to try to enjoy it for the story (then again, Doctor Who has never been overly concerned with presentation, the most fearsome aliens in the galaxy being metal boxes with plungers sticking out of them is quite silly). Same with most CGI in the older movies or even the style of older anime, it can all be a bit hard to watch. I guess I also experience the same with video games, though to a lesser degree - some like Hidden & Dangerous 2 can still be enjoyed whereas something like Operation Flashpoint would be quite frustrating, though more often due to controls rather than graphics. Ehh, they did what they could at the time.
- KronisLV 3mo agoAlso, just to be clear, the AI generated videos are quite trash. However, you could imagine that maybe with a decade of refinement they'll get better - the existing prompting and composition were okay, it's just that they were plain bad technically. Then again, so was Will Smith eating spaghetti.
- aenvoker 3mo agoAs a clanker-apologist I gotta say this is the strawman of AI slop brought to life. Letting the machine do literally everything without even supervision and see how it turns out? No surprise at all the results are so bad. My fav AI video is still Post-Scarcity Blues from a year ago https://www.youtube.com/watch?v=q_t3h2AZ0KY https://www.youtube.com/watch?v=q_t3h2AZ0KY There have been others I've enjoyed since then. But, that one stands out in memory. Work warning: it is occasionally just a bit spicy.
- s1artibartfast 3mo agoPretty amazing stuff and evocative. Thanks for sharing to put things in perspective.
- Jonovono 3mo agoThis is my favorite AI generated (or assisted?) music video: https://www.youtube.com/watch?v=ctBpVI6lRyo https://www.youtube.com/watch?v=ctBpVI6lRyo
- abstractbill 3mo agoThese are pretty terrible, but for me there were at least a few moments where they genuinely became "so bad they're awesome". They actually re-enforced an idea I keep coming back to: sometime soon a real artist is going to use AI to make something amazing, not by aiming for flawless "realism" or some kind of pastiche slop, but by leaning into the weirdness that often comes out of AI.
- yapyap 3mo agoclaude’s is bad and chatgpt’s is horrific
- dayvid 3mo agoThere's definitely still room for innovation in custom use cases with AI. I like to write and draw comics, but it's very time consuming to make a finished product. Working with tools in default and you'll have a bad time. You have to really guide it and if you're using a longer story to adapt, it'll compress things and lose context during Thinking. Luma labs was the most interesting tool I've seen so far, but there's still a lot of room for growth
- franze 3mo agoI did let Claude Code Opus + OpenRouter API Key (limited to 25EUR) create an an Arthouse Video about "Is AI art or can it go?" https://m.youtube.com/watch?v=E6XofKqFYeQ https://m.youtube.com/watch?v=E6XofKqFYeQ I like the scene with the hands.
- throwa356262 3mo agoPlease repeat this with models from MiniMax: https://www.minimax.io/news/minimax-hailuo-23 https://www.minimax.io/news/minimax-hailuo-23 (No affiliation, I just want to see how well they work).
- SwellJoe 3mo agoEven their demo clips are soundly in the uncanny valley, and I assume normal folks using it and having to pay for each clip will have generally worse results.
- tantalor 3mo agoEmbarrassing! You can still delete this, there is time.
- adenta 3mo agoWhat's embarrassing?
- tantalor 3mo agoThe outputs
- samspenc 3mo agoThe post itself was technically useful, I found, and they posted their entire project to GitHub https://github.com/hershalb/music-video-arena https://github.com/hershalb/music-video-arena which I think makes it worthy of a HN post and discussion since it is technical and at least IMHO a very interesting post.
- victor9000 3mo agoThese videos are far from good, but it's possible to create a decent AI music video if you use a human-in-the-loop workflow: https://www.youtube.com/watch?v=52Km88uAZ4M https://www.youtube.com/watch?v=52Km88uAZ4M
- s0rce 3mo agoRobot characters keep you away from uncanny valley of creepy slightly off AI humans. Still fun though.
- walrus01 3mo agoUnexpected appearance of the NCC-1701 Enterprise at about 0:40 into the video, but no appearance of star wars star destroyers?
- tim-- 3mo agoIf we're talking AI music videos that are amazing with a human in the loop, I really enjoy Snoop Dogg's music video for "Last dance with Mary Jane". https://youtube.com/watch?v=rseqmSGH7xk&t=59s https://youtube.com/watch?v=rseqmSGH7xk&t=59s > From the start, the production team knew they didn’t want a music video that relied solely on any single technique. With this goal in mind, they worked to blend live action, AI, and a wide range of handcrafted animation styles – 2D, 3D, collage and motion design. https://lbbonline.com/news/psyop-and-temple-cache-get-surreal-with-experimental-new-snoop-dogg-music-video-last-dance-with-mary-jane https://lbbonline.com/news/psyop-and-temple-cache-get-surrea...
- qnleigh 3mo agoThese are funny the first time you see them, but I guarantee if you watch a few you will start picking up how similar they all are and it will all start to feel like slop.
- MaximTsyg 3mo ago[flagged]
- tedggh 3mo agoThey are terrible. Perhaps if one on purposely prompts for a weird imaginary, the result could be less awful even acceptable, like that famous Gucci ad. These videos instead are common scenes with the super cringey AI artifacts.
- stusmall 3mo agoDid it misunderstand "don't believe me just watch" and put a bunch of washing machines in on the Fable 5 $100 at about 1:20?
- hasbot 3mo agoHow well do these models do producing a proof-of-life video? Asking for a friend.
- mcphage 3mo ago…is your friend… er, was your friend, a US Senator, by any chance?
- squidsoup 3mo agoPlease stop using AI for creative work. This is utterly abysmal.
- arjie 3mo agoPretty neat that the gallery of videos plays from where the previous one was paused. Nice UX.
- NDlurker 3mo agoSpice 1 released an AI video for Jealous Got Me Strapped. Got a young AI Spice 1 and Tupac. I see on his channel he put out another AI video in 2024. https://youtu.be/j36hjNuAIWQ https://youtu.be/j36hjNuAIWQ
- xoxxala 3mo agoInteresting article, but those videos aren’t. Not even pre-MTV quality. While checking out the gallery, came across this image: https://www.tryai.dev/gallery/d3725e9b-1df9-4c10-8a23-2fc705d011d8 https://www.tryai.dev/gallery/d3725e9b-1df9-4c10-8a23-2fc705... There’s something wrong with it, but I just can’t put my paw on the problem.
- qwerpy 3mo agoFor fun, I took that image and put it into a few models and asked it "what is wrong with this genAI image?" Grok fast came up with a lot of minor quibbles and missed the issue. Grok expert touched on it with a "Limbs/anatomy ambiguity / This creates a slight "how many legs does this cat actually have?" moment." but then moved on to complain about texturing . Later it summarized the issue as "classic "animal + held object" anatomy problem". Chatgpt 5.6 instant didn't notice it Chatgpt 5.6 medium didn't notice it and mainly complained about the background being blurry Chatgpt 5.6 high (46s) "The biggest error is the cat appears to have six paws" Google AI mode complained about whiskers and feet placement Only chatgpt high and marginally grok expert had acceptable answers.
- Mistletoe 3mo agoWelcome to the Age of the Plateau. Enjoy your stay, everything is very mid, but it’s oh so cheap to make.
- opengrass 3mo agoPassable as an episode of Robot Chicken.
- fragmede 3mo agoI don't know how much WickedAI is putting into creating their videos, but if you want examples that aren't terrible, https://youtube.com/@wickedai https://youtube.com/@wickedai
- coldtea 3mo agoI mediocrity was a visual style.
- valar_m 3mo agoI'm fascinated by some of the comments in here, that the videos are "awful," "far from good," "embarrassing," etc. This is technology that was unthinkable before just a couple of years ago. Photorealistic video generated by typing out a description of what you want to see is something from a sci-fi movie. I must be dreaming, this can't be real. I took a screenshot in the middle of a video, and it's indistinguishable from a photograph: https://imgur.com/a/TyNbd7E https://imgur.com/a/TyNbd7E I don't know, maybe I'm just old. I remember hacking the hidden iframe trick to make ajax-style file uploads work in IE7. The advancements I've watched unfold in the past couple of years are still hard to wrap my head around.
- krapp 3mo agoNo one is criticizing the photorealistic video generation. Yes, AI has gotten very good at that, I don't think anyone is disputing that. At some point you have to move past your astonishment at the technical achievement alone and judge the result for what it is, on its own merits, as if a human had made it. Especially when the goal of using generative AI is to remove as many human creators and as much human effort from the creative process as possible, and to have as much "art" be as fully AI generated as possible. People are criticizing these videos because they aren't good. As "art." Which is a problem if this is what all art is supposed to be become.
- throw310822 3mo ago> judge the result for what it is, on its own merits, as if a human had made it. I don't think anyone was proposing this as an actual professional music video, right? It's a tech demo that used all of $25 of budget. So why are you judging it "on its own merits, as if a human had made it"?
- krapp 3mo agoMost of the "professional" AI generated content I've seen isn't much better than this. It all lacks in the same dimensions, it's all the same sort of mediocre and uncanny. Claiming "it's a tech demo, actually quality doesn't matter" isn't going to cut it when this technology is already replacing actual human professional work. Besides, several people in this thread have already decided that these tech demos are better than human created music videos. In fact, many AI "artists" already claim generative AI has surpassed humans in every relevant metric and they judge it on the same merits as I do just coming to the opposite conclusion. They certainly aren't waiting until it's "good" to call it art. So it's entirely valid to point out that this technology is actually bad at doing the thing it's supposed to do.
- deleted 3mo ago[deleted]
- deleted 3mo ago[deleted]
- walrus01 3mo agoI wonder how much worse this would be if instead of starting with a human-created song: https://en.wikipedia.org/wiki/Uptown_Funk https://en.wikipedia.org/wiki/Uptown_Funk Start from an entirely AI generated song, and have an AI generated video. We apparently already have an example of such: https://www.youtube.com/watch?v=MWLLIjOTqkE https://www.youtube.com/watch?v=MWLLIjOTqkE
- f3408fh 3mo agoI always found the Severus Snape - ALWAYS (Live at Hogwarts) video to be really good for AI. The video was probably created by prompting for each scene, instead of letting the model generate the whole thing. It's a cool of example of what's possible nonetheless. https://www.youtube.com/watch?v=SlsEDkavoso https://www.youtube.com/watch?v=SlsEDkavoso
- BLKNSLVR 3mo agoLooks like some auteur-level work on the prompting to keep all of that so tight. That really is great. Trent Reznor would make a decent Snape...
- userbinator 3mo agoThat's definitely not "let the AI do everything unsupervised", but many short scenes generated with probably much filtering, and then manually edited together. It's interesting how the Harry Potter fanbase was one of the first to get on the AI video trend, but not too surprising as there was already plenty of HP fanfiction, and no doubt many who wanted to have them visualised. Here's another channel with a ton of AI parody videos: https://www.youtube.com/@NeuralDerpMusic https://www.youtube.com/@NeuralDerpMusic
- willmeyers 3mo agoIt's an interesting experiment and the results are surprising. I will say that if you're a musician I'd bet anything you can make a way cooler and better music video for $25 and 45 minutes with your friends.
- eterm 3mo ago$25 is an exaggeration, because that wouldn't even cover lunch for your friends to say thanks for the favour. OK Go blew up early youtube with Here It Goes again: https://www.youtube.com/watch?v=dTAAsCNK7RA https://www.youtube.com/watch?v=dTAAsCNK7RA . But these are exceptions to the rule, most people don't have the ability to do much creatively with a shoestring budget. ( Which isn't to say this slop is better. This slop is far worse, it's utterly dreadful. )
- Jtarii 3mo ago>most people don't have the ability to do much creatively with a shoestring budget. I'm sure in a room full of musicians they could come up with more creativity for a video than literally 0, which is what LLMs are currently capable of.
- BLKNSLVR 3mo agoThis is how you do AI music videos: https://www.youtube.com/watch?v=Njk2YAgNMnE https://www.youtube.com/watch?v=Njk2YAgNMnE Lean into the not-quite-but-almost uncanny-valley-ness. Make it a feature, not a bug.
- tsunamifury 3mo ago[flagged]
- nullstyle 3mo agoNah, us fiends watch things like https://youtu.be/TuGg0aMO1NI?is=zFRpAeel1keKFbsb https://youtu.be/TuGg0aMO1NI?is=zFRpAeel1keKFbsb
- tsunamifury 3mo agoFrench surealism is a very differnet thing that random LSD imagery.
- nullstyle 3mo agoYou must be tons of fun at a dinner party
- tsunamifury 3mo agoTired and low effort.
- nullstyle 3mo agoTakes one to know one, “we get it you do drugs”-boy.
- BLKNSLVR 3mo agoNow _that_ is freaking amazing. I couldn't look away for the whole thing.
- deebosong 3mo agoNo need to take any pot shots at this trash in terms of aesthetic efficacy in earnest, if y'all know what I mean. But as an experiment, it's interesting. There seems to be an odd consistency to all of them, which reveals a kind of internal logic & coherence of sorts that courses throughout any iteration. Aesthetically, where can you place these? I feel like the late David Lynch could have used some tropes in his unnerving, unsettling dream sequences (a la the intro dream in "Mulholland Drive" where people are so cheery and upbeat that it feels viscerally disturbing). That's the consistent feeling that I'm left with watching each one, is just a deep, deep unsettled and uneasy feeling. A scowl on my face the whole time trying to make through each one. I did crack up seeing a martini glass presented to the camera, then float in place on it's own and the presenter resumes holding it with his other hand. Everything else made me nauseous.
- red75prime 3mo ago> I did crack up seeing a martini glass presented to the camera, then float in place on it's own It's just a cheap video-generation model doing its thing. I wonder if the orchestrator model noticed this and tried "Create a scene with a martini glass. Make no mistakes".
- marknutter 3mo agoHow about the full 360 head turn in the first video. Nightmare fuel.
- beezlewax 3mo agoThis absolutely is the opposite of what I want to see in a music video
- dialogbox 3mo agoThe results are pretty bad for a top stars music video. But it's pretty impressive for not very important short clips like insert shorts of cheap Ads. I'm scared because that's the most labor intensive area. Top talents will survive but all the volume industry will collapse.
- RealStupidity 3mo agoI think that a lot of posters here are missing the point - this is just the tip of the iceberg, and even simple improvements in prompting (infer the meaning of the lyrics, then generate footage related to that) would create a better result. There is no going back from this, only forwards, for better or worse.
- dfxm12 3mo agoRecurring characters drift between shots, and none of the videos hold a coherent storyline from start to finish. Stuff like veo 3 can't always hold a coherent storyline for 8s. It's asking too much to expect a whole, coherent music video.
- Fricken 3mo agoNo effort went into that. No talent went into that. The creator doesn't care about the outcome. Nobody wants to watch it. Fucken A, brilliant. The intelligence is artificial.
- prodigycorp 3mo agoOP really figured out the secret to getting on the frontpage. Three frontpages in a row lol
- RIMR 3mo agoI don't care that the results are technologically impressive, the automation of creativity is dystopian. As I watched these videos and tried to compare what different AIs can do with similar budgets, is struck me to how utterly soulless and unenjoyable this whole thing is. AI has plenty of utility, but this isn't one of them. If anything, I want to see AI automate all of the tedious stuff so that human beings can focus more deeply on art and culture. Automating art and culture is anti-human.
- dwa3592 3mo agoCan I just say that they look awful?
- erickhill 3mo agoGPT is missing a beat
- slyall 3mo agoGood creator of AI music videos (with human editing etc) is "ALFfx Visual DJ" Example: https://www.youtube.com/watch?v=4lWArXcsxYo https://www.youtube.com/watch?v=4lWArXcsxYo https://www.youtube.com/watch?v=pn-4lIFhybA https://www.youtube.com/watch?v=pn-4lIFhybA https://www.youtube.com/watch?v=9kjUEan_fgM https://www.youtube.com/watch?v=9kjUEan_fgM Most of their videos have a similar retro-futurism look
- VladVladikoff 3mo agoThese still seem awful to me. There are weird events in them that take me out of the moment like the record needle suddenly jumping of the record for no apparent reason. But more so I just hate the AI glaze look of all the characters.
- hackmack10 3mo agoThese videos are awful.
- boca_honey 3mo agoI don't have a problem with AI and can't stand the anti-AI brigade, but... this is the worst thing I have ever seen in my life. This specific type of garbage is exactly what arms the anti-AI critics with valid arguments. We should really wait a few years for the technology to mature before releasing these kinds of projects into the cultural sphere.
- bjourne 3mo agoEh, I'd like to see YOU make a better music video for $100 or less!
- byzantinegene 3mo agoor i can just not do it? this absolute garbage of a music video is not worth a single cent, let alone a $100.
- stale2002 3mo agoWhat do you mean, I thought it was fun. Feel free to not make your own music videos, but I am not sure why you would be so upset about other people having fun.
- scarecrowbob 3mo agoPeople say this a lot, and I usually think it's said by folks who haven't thought about it much. As a person who makes a lot of music, I don't care if folks have fun. In fact I am having such a hard time caring hat folks do or how they do it I can't get motivated to book any shows this season. But the part you're missing is when folks make these things and then say "yeah, you see this thing we're doing? That's what we think -you- are doing." LIke when someone sets up an LLM to shit out some song lyrics, I don't care if they are having fun doing it, but I think it displays a lot of contempt for [insert an songwriting artist youlike here] to claim that the LLM is doing the same thing. Which is fine and all- I've got plenty of unmitigated contempt for my fellow humans. And you don't even need a computer to do that- I've released a certain amount of music that is facile and boring and in retrospect understand why folks were dismissive. But if you want to understand why folks who consider themselves invested in their craft (or even invested in other artists' craft) are dismissive of these things, then you might consider how radically dismissive of craft these kinds of cultural products might seem to artists.
- zkmon 3mo agoThe cutting edge technology is being tested with pelican drawings and video creation. You may argue that this is just testing, but actual mainstream use of this tech won't be far off from these tests.
- xfeeefeee 3mo agoNot a fan really. There are certainly uses for AI, but this is lacking something. Personally I think it works best as a filter or applying a style or effect that is difficult otherwise, or generating fancy ambient or abstract textures etc. People constantly think the music video I created for Zingara's Unlock Your Keys [1] is AI, but it really is just real footage all around, except for a handful of lines / pulse textures that were created in TouchDesigner. I am really excited for the possibilities that AI can give us in the future but often I find trying to use it generatively I run into the paradox of choice and end up paralyzed! 1: https://xfeeefeee.net/unlock-your-keys/ https://xfeeefeee.net/unlock-your-keys/ tribal dance fusion music video, sfw but does show some skin. Uses lots of slow motion ink in water footage for texture as well.
- deleted 3mo ago[deleted]
- nearbuy 3mo agoIt's a strange experiment. Claude and GPT aren't generating the video. They're directing and editing it, and they request video from a generative video model using mainly text-to-video. Neither Claude nor GPT can actually watch video content, and the video model generates shoddy quality clips with artifacts, lack of consistency, and where actions aren't synced to the music. It would be very hard for anyone to make a good music video with the tools Fable and Sol had available to them. They don't have precise control over the clips that get generated, and they can't see or hear the result, other than screenshots. So I'm not sure what the experimenters expected.
- jackb4040 3mo agoAgree. It's pretty clear the purpose was not to take even a small step in the direction of musicality for llms or video models. More of a typical "agentic engineering setup" blog geared to a different type of professional
- anon7000 3mo agoTangent: philosophically to me, art is inherently human. What makes art meaningful and impactful isn’t whether it looks good or cool. It’s the story of the artist, the context of the art itself, the hard work and struggle involved, the meaning represented by a human creating something very specific to their own personal context and taste. Or a mix of any of that. Can AI be used as a tool to help create art? Absolutely. But as a rule, I do not give any shits about AI generated content like this. It’s not art. It’s not human. And the line is really how much meaning and effort _a human_ is putting into it. If a human spends a minute or two prompting AI and then tweaking The result, and peddling it as their own art… get outta here. You made some content. That’s easy, and no one should cares. Content can already be shoveled out faster than we can watch it with or without AI. Meaningful art is not mass-produced, generated content. I realize art is completely subjective, so some person may find meaning in AI generated art. That’s fine, and that’s part of what could make that art. (Like an original way of presenting something that really resonates with someone.) But this garbage ain’t that. And I realize this is just a capability test, but plenty of places will see this as cheap and good enough. But it ain’t art, and we should push back against another cost-cutting measure that does nothing to make the world better.
- eru 3mo agoAll of this can be said about photography, too. And, yes, most photography ain't art, or at least not meaningful art. Just like most of my attempts at drawing ain't meaningful art either. Btw, by your high standards most human produced music videos ain't art either. See https://en.wikipedia.org/wiki/Potboiler https://en.wikipedia.org/wiki/Potboiler
- BLKNSLVR 3mo ago> most human produced music videos ain't art either Sounds accurate to me
- interroboink 3mo ago> Meaningful art is not mass-produced, generated content. Andy Warhol might disagree [1] (: (I realize that's not exactly apples-to-apples, but y'know.) Or there's "art is anything you can get away with," which I just mention to point out that this kind of issue ("what is art?") is not new. In some ways it seems like a good thing to get people, like you, riled up about these topics, arguing the merits of their point of view. That's how culture happens. It's an interesting question you tangle with: is it art because of what the artist did, or is it art because of how the viewer/listener/etc receives it? Some of both? How much of each? If you encountered some art but you didn't know its provenance, and it had some emotional impact on you, would it still be art if you found out later it was 100% AI generated? Like you say, it's all subjective, but it's nice to see random people on the internet talking about the nature of art, since it's something I care about too. So in other words, thank you for being angry (: [1] https://en.wikipedia.org/wiki/Campbell%27s_Soup_Cans https://en.wikipedia.org/wiki/Campbell%27s_Soup_Cans "... what Time magazine called the 'Slice of Cake School'—artists who treated the banal artifacts of contemporary civilization as legitimate subjects for high art"
- ele11 3mo ago[dead]
- sandspar 3mo agoAwesome! Other commenters are negative but I'm very excited to welcome AI into the artistic community. The more the merrier. Can't wait to see what they come up with!
- eth0up 3mo agoSlightly off topic, but earlier today I was bored, having a kibitz with Claude, and I asked if it played chess. I was surprised when it confirmed, with a humble yes and disclaimer of its mediocre strength. I then asked if it happened to also play Go, which has been my preference for many years now. I was surprised when it again confirmed yes, but admitted it was even weaker here. Where I began to feel delightfully uncomfortable was when it asked me if it should build a Go board and start a game. Surely you jest, Mr Claude... I thought. No. The crazy bastard built a beautiful HTML/SVG board, and before I knew what was going on, there it was. I thought for a moment that fraud rhymes with something. Then before I knew it, I was black (that's courtesy!) and I made my first move expecting nothing, kind of astonished by what was happening. Mind you, I was on a phone. Then it made a move in response, and lo and bloody behold, I was playing a game of Go with Claude, on a 19x19 board made in a few seconds, with formidable aesthetics. I was enamored enough to overlook that Claude does need some practice. But wow. I guess everyone is impressed by something, but that got me.
- pianopatrick 3mo agoThe visuals are good enough to be interesting. I just don't like the shot selection / story writing
- deleted 3mo ago[deleted]
- blightful 3mo agoThe future is pretty obvious. People spending thousands of hours honing the skills of being able to create visual art will dwindle. The same will be true for many creative endeavors. Artists will still exist and some will be able to make a living from it but it will rare. Slop will prevail. Most people will lose the ability or care to try and tell the difference. The attention wars have a lot of time to go. The addicted are kids and teens and young adults at this point and I see little to make me think they break out of it any time soon.
- tim-projects 3mo agoThe creative in me would rather take the cursed parts of of the cheap models and edit them together.
- sourcecodeplz 3mo agoid like to see AI dance & sweat and sing on stage...
- sensanaty 3mo agoTruly impressive that we're burning trillions of dollars for this abject garbage. I'm so glad people can't buy RAM anymore so that we can shit out some more soulless slop - and this really is the definition of slop - like this
- ElijahLynn 3mo agoTIL that Fable and Sol generate video...
- Mashimo 3mo agoCan't tell if this was a joke, but they don't. They had access to video generating models and a budget for it.
- ElijahLynn 2mo agoAhh. Thanks for clarifying that. I used Claude the other day to drive my codex and agy (anti-gravity) clis iterate on a XKCD like film strip. I needed to teach people how my product worked. It did surprisingly well!
- antfarm 3mo agoI think these videos are a great way to visualize what is wrong with the "personality" of LLMs: they are shallow, unoriginal, overconfindent. The videos convey this in a more vivid and direct way than any text answer could. I often have the thought that if Claude were a human colleague, I'd avoid having to work with them.
- deleted 3mo ago[deleted]
- hbn 3mo agoLike most of this stuff, it's obviously impressive technology compared to what existed a few years ago. But the end product has zero artistic value. It's a grey goo of the average of every concept picked up from the concept of the song. A talented creative with a vision could make something more interesting and enjoyable in an afternoon with a $0 budget.
- onesandofgrain 3mo agoWe dont need music videos though. Music videos are absurd and meaningless.
- AIorNot 3mo agoAh man I love the music videos of the 90s Spike Jonze had so many creative ones
- Mashimo 3mo agoWhy are they absurd and meaningless? Can be art and creative, just like the music.
- onesandofgrain 3mo agoMusic videos take attention away from the actual art. It's purely a gimmick to make bad music sound better. ... and no, music videos are not art.
- brabel 3mo agoYour definition of art is not in agreement with any artist’s interpretation I’ve ever heard. It’s like saying a movie based on a book is not art , it just distracts from the book.
- onesandofgrain 3mo agoI don't care about being in agreement with "any artist's interpretation". And stop appealing to the masses argument, it's cringe. No, a movie based upon a book is the same art just told in a different way, but I'm not buying that rappers driving luxury cars while rapping and having women in stripper heels tells the same musical artistic story in a different way. Or some random story.
- swiftcoder 3mo agoFeel like a lot of comments are missing the point here - the authors weren't trying to make a great music video, they were trying to test independent tool use. Despite how awful the end result may be, the models did successfully plan and execute a moderately complicated generation and editing process.
- jrm4 3mo agoThe interesting irony of using Bruno Mars, who, for my taste, really is something like Human AI. Uptown Funk is a very enjoyable track -- but if you're familiar with his influences, it can make his music generally stale and unenjoyable. Like Silk Sonic has the technical sound of that era, but it feels like they're treating it like a joke.
- sails 3mo agoFor what it’s worth I tried an experiment where I had a similar harness (where LLMs competed head to head playing snake) and made them aware of their budget and it had very little impact. This was cheaper open weight models
- qbit42 3mo agoAI is destroying the economics which allowed for a sizable middle class of artists. The issue is that many are paid for their art mostly for its aesthetic rather than artistic value. This isn’t the most creatively fulfilling, but it previously allowed many artists to make a living while refining their skills, often enabling them to pursue their real creative ambitions on the side.
- marsven_422 3mo ago[dead]
- flohofwoe 3mo agoI'm not sure if AI slop will make a bad situation much worse tbh. The pop stars of the 60's to 90's always depended on a distribution platform/network (record labels, radio stations, MTV, ...). Those distribution platforms either don't exist anymore, or changed their 'business model' to f*ck the artists at least two decades ago. To find the really good stuff you already have to look elsewhere, and popular music was already 90% mass produced "slop" before AI entered the scene. E.g. this ancient Frank Zappa interview about the decline of the music industry is still as relevant as ever: https://www.youtube.com/watch?v=KZazEM8cgt0 https://www.youtube.com/watch?v=KZazEM8cgt0
- watwut 3mo agoI think it will make a bad situation much worse, because CEOs of OpenAI and Antromorphic along with investors actively want to make it so. If they get more power, they will you that power to make the artists bad situation worst. They don't have that power yet, but are consistently actively trying to worsen the situation for the last 4 years. They proudly bragged about achieving the bad situation like 2 years ago already.
- qbit42 3mo agoIt was already bad, but I think there is still room for it to get a lot worse unfortunately.
- kdheiwns 3mo ago
- ben8bit 3mo agoProbably a good example why you shouldn't outsource creative work to AI.
- deleted 3mo ago[deleted]
- seu 3mo agoAll videos are so full of stereotypes and clichés, often borderline (or just plainly) racist. But of course, that's not the main worry for people making these things, right...
- shmeeed 3mo agoDoes the original video fare any better? https://m.youtube.com/watch?v=OPf0YbXqDm0 https://m.youtube.com/watch?v=OPf0YbXqDm0
- cyclopeanutopia 3mo agoIt's amazing that someone used those awful videos as a showcase for anything. :)
- michelb 3mo agoInteresting how bad this is when you don't use video models and your own direction. The first two clips are made with Kling (not affiliated, but I use it myself): https://xcancel.com/PJaccetturo/status/2076312902685085815#m https://xcancel.com/PJaccetturo/status/2076312902685085815#m Obviously not one-shot, and finalised in a video editor. It's quite doable to get this kind of fidelity.
- ctippett 3mo agoThanks for sharing this, I'm not sure I would've come across it otherwise. Ironically, watching the two shorts had me second-guessing whether what I was watching was actually AI-generated and not created by a professional. It's like peeking at what lies beyond the Overton horizon... only to see it wrap around until we're right back where we started.
- deleted 3mo ago[deleted]
- neonstatic 3mo agoWow, I hate all of it
- Zopieux 3mo agoWoah that sucks. Closed the tab when I saw the cartoonishly stupid, completely out of place smoking thermometer. A music video is not (necessarily) a depiction of what the lyrics say at any moment. Soulless for sure.
- rrr_oh_man 3mo agoThe AI slop humans always look they are amazing by the fact they can move around, in slow motion.
- mvdtnz 3mo agoAbsolutely horrendous and devoid of any value whatsoever.
- marysol5 3mo agoAlways nice to see that it still really struggles with the nuances of human movement and self-interaction. Especially when it comes to clothing overlapping.
- yanexr 3mo agoThe result depends mostly on two things: The first is the LLMs ability to come up with a good story, choose and prompt the video model, evaluate and editing. The other is the quality of the video models themselves. The LLMs mostly used older video models from a year ago that are capped at 10 second single shot clips. Newer video models like Seedance 2 go up to 15 seconds (Seedance 2.5 even up to 30 seconds) and they support multimodal references. As a tool, I think those video models can be pretty amazing for artists as you can create things not possible before. Here is a music video made by an artist using Seedance 2: https://www.youtube.com/watch?v=yYfDJQxyHFg https://www.youtube.com/watch?v=yYfDJQxyHFg
- paganel 3mo agoThe videos are lame as fuck. This is what they’re spending trillions of dollars on, absolute madness.
- tarosnow 3mo agoThese videos have the "karaoke" vibe to them
- andai 3mo agoYou may live to see man-made horrors beyond your comprehension. -Nikola Tesla
- ozgung 3mo agoOne thing all models aced was the costume design. I don’t know why this was the case. Maybe they trained exclusively on lots of fashion data to use models in fashion industry. Filmmaking is inherently an iterative process. You don’t normally one shot music videos in the real world. Agents should review and iterate at every step of the process. Lots of room for improvement here. Also for comparison, budget of the original Uptown Funk music video was probably around $100,000. Even “indie” is pretty expensive in traditional filmmaking due to high cost of equipment, people and places. 100x cost reduction is huge for any industry.
- spongebobstoes 3mo agotoken cost for the $100 video was $3.25 for Sol 5.6 and $25.05 (!) for Fable 5 for the $25 video it was $4.27 (Sol) vs $16.99 (Fable) this seems like an interesting benchmark of a complex task, even if the output has little artistic merit. the efficiency of Sol is impressive
- dudeinhawaii 3mo agoWatching the videos and reading the methodology, it feels like "scientist one-shot music video with LLMs" which is... useful but in no way represents how one would use the models. If nothing else, it serves as a great reminder that you can't offload taste and creative decisions to AI. AI is also not a mind reader. It _may_ do a useful thing sometimes - but it's much better to codify that thing in your requirements if it's something you want to occur consistently.
- teampmladv 3mo ago[dead]
- roni3 3mo agoI am shocked at the good quality of the output. Might not be great from an art standpoint (according to the other comments), but that's just a question of time (not a lot)
- deleted 3mo ago[deleted]
- circlefavshape 3mo agoImpressed by what utter shit this is. Music video creators are safe for a while yet
- deleted 3mo ago[deleted]
- ge96 3mo agoSome tells, the face, reflections on faces, multiple legs, no sense of gravity
- 100percentjake 3mo agoAll these AI discussions seem to lack the nuance that the real utility of these tools will come in the finer points. GPT? Sure, you can write a book with it, but in writing its use as a tool by a real human is perhaps best when it is providing a jumpstart to creativity. If I'm writing a script I might have a chatbot give me a rough outline which will usually be complete garbage that I throw away 90% of but it got me over the decision paralysis of getting started. Image generation? Sure, you can create varying degrees of body horror wrong-hand imagery and ugly-as-sin event flyers. But it's also indispensable for, as an example, object deletion and cleanup workflows within Photoshop. Or intelligently letting me change the paint color of a car while preserving the reflection's tones and realistic shadows. Video generation? Sure, you can make ugly nonsensical slop but I imagine it will be hugely useful for AI driven rotoscoping, quickly creating placeholder or background resources. Of course, the ethics of how this training data was all gained creates an entirely different aspect of discussion. Supposedly Adobe's image generation, by far some of the worst on the market, is so bad because it is ONLY trained on imagery that they already have reproduction and usage rights to. Which tracks, because it does an admirable job of erasing an ugly building and revealing trees and a field behind it, but anything that results in it having to generate stuff more complex than the landscape photography that makes up the glut of its training data has... hilarious results.
- scuppernong 3mo agohappy to see this is still ugly unwatchable dogshit
- syed_qutub3 3mo ago[dead]
- BatFastard 3mo agoI found these hilarious! I was ROFL over some of the mistakes the AI made. Parts of it was amazing, other parts were amazingly off.
- dsign 3mo agoWell if AI destroys bad music videos by making them cost $25, I say it's a win. What will be left will be seriously scripted productions.
- duxup 3mo agoI'm not really a music video watching person but the output of these videos seem almost like non serious memes mocking music videos.
- cortexosmain 3mo ago[flagged]
- Alien1Being 2mo agoTruly dreadful.