6 ms·
H3-metal – Native MiniMax-H3 inference for Apple Silicon
- TechSquidTV 2mo agoThis still requires 128Gb of memory, right? Me and my lowly 96Gb, like a commoner; missing out on the fun.
- thehamkercat 2mo agoFrom README: > On the 128 GB M5 Max, clean end-to-end image+audio and embedded-video+audio renders completed in 74.58 and 76.99 seconds respectively, each with about a 40.1 GB peak physical footprint and zero swaps. Looks like it uses 40GB? So your 96GB mac setup should work fine i guess (Model itself is 33B)
- vunderba 2mo agoThis repo looks neat, but I hope they add some more clear benchmarks because that time (74.58s) is pretty meaningless given that the it/s (and total time) is highly dependent on mode (T2V vs I2V vs REF2V), resolution (0.4, 0.6mp, etc), duration (5-15 seconds), etc.
- pferdone 2mo agoyou should have a look at https://github.com/deepbeepmeep/Wan2GP https://github.com/deepbeepmeep/Wan2GP which is the goto tool for "gpu poor", although as people below already pointed out you should be fine with comfyui's standard setup aswell
- embedding-shape 2mo agoFirst, I think they're not even talking about GPUs, this is macOS hardware so unified memory. Secondly, if they were talking about GPUs, then 96GB VRAM is hardly what people refer to when they say "gpu poor".
- pferdone 2mo ago1) It would still run on the Mac's GPU. 2) Since it's unified memory, you won't have 96GB available. 3) I offered a solution that is usually recommended to the "gpu poor", if he's concerned with how much memory he would need. 4) I stated, that people already pointed out how he should be fine and that "gpu poor" doesn't apply to him. 5) "gpu poor" depends on what model you are trying to use. If you want to run Kimi or GLM you are still "gpu poor" even if you have an RTX Pro 6000 with 96GB of VRAM.
- embedding-shape 2mo agoIt shouldn't? Unless you're using BF16 for all weights (I'm using NVFP4 for the text encoder, otherwise everything BF16 (and audio F32)) you'll fit it all within 96GB VRAM, bugs non-with-standing :) I've been fitting this within 96GB VRAM without issues.
- Arn_Thor 2mo ago*notwithstanding Anyway, good input!
- embedding-shape 2mo agoI'll blame it on other book authors! :) https://en.wiktionary.org/wiki/nonwithstanding https://en.wiktionary.org/wiki/nonwithstanding > This misconstruction is very common, included in print publications spanning several centuries. It might be considered an alternative spelling, albeit still a mistaken usage. Thanks though, I never actually knew so was helpful :)
- cindyllm 2mo ago[dead]
- deleted 2mo ago[deleted]
- abhinai 2mo agoHow similar are Jeff Dean and Salvatore Sanfilippo?
- onionisafruit 2mo agoMy favorite Jeff Dean fact is that he’s also antirez. Which reminds me of my favorite Salvatore Sanfilippo fact. He’s also Jeff Dean
- tomcam 2mo agoI'm totally following this
- ralusek 2mo agoIs that what the identity function is?
- silisili 2mo agoIt's why javascript had to add the triple equals check...
- muragekibicho 2mo ago2 is not enough. 3 verifies the Dean-Sanfilippo correspondence.
- hnfong 2mo agoThe claims seem fitting from a user named "onionisafruit"...
- freakynit 2mo agoIdentify theft is not a joke Jim!
- robotresearcher 2mo agoPeople are really good at stuff. I noticed on a bar TV the other day that some of the Chromecast screensaver landscape photo credits were to Peter Norvig. They were really lovely pictures.
- Meleagris 2mo agoI've been using MiniMax H3 on my M5 Pro 64GB MacBook Pro through ComfyUI. It works extremely well. I had to modify the default ComfyUI workflows to use a GGUF quant (city96's ComfyUI-GGUF custom node, UnetLoaderGGUF in place of the stock loader) [0]. I use the model labeled Q5_K_M. There is Q8_0 available as well, which is 34GB and fits fine in 64GB unified memory if you keep resolution modest. The main issue is speed, a ~9-second 480x864 clip at 20 steps takes me a bit over an hour. So this will be cool to try for the speed up alone. There's a lot of great information and workflows available to follow on the r/StableDiffusion subreddit. [0] https://huggingface.co/Abiray/MiniMax-H3-GGUF/tree/main/unet https://huggingface.co/Abiray/MiniMax-H3-GGUF/tree/main/unet
- alexgoodhart 2mo agoI wonder how much faster your m5 pro is compared to my M1 Max @ 64gb
- yieldcrv 2mo agowait till the M7 bro you’re almost there, rumor has it that Apple is skipping the M6 but it still might be 2028
- ignoramous 2mo agoDiscussion: https://news.ycombinator.com/item?id=48676795 https://news.ycombinator.com/item?id=48676795
- jonplackett 2mo agoWhat is the quality of the output like compared to something like Veo?
- Art9681 2mo agoIt's better than all private video models like Veo. Yes, I too am incredulous they released this open weights. It's a VERY disruptive model in all the good ways.
- c0rruptbytes 2mo agowow antirez does not sleep
- mlmonkey 2mo agoUnderstatement of the year :-D
- behnamoh 2mo agowhen you have enough money to not have to worry about anything, you can go back to your hobbies. in this case, his hobby is programming.
- stressback 2mo ago"enough money not to worry about anything" haha
- azinman2 2mo agoBeing a world class talent is independent of financial situation.
- behnamoh 2mo agotalent w/o financial stability is a battery w/o circuit.
- deleted 2mo ago[deleted]
- afavour 2mo agoOf course it isn’t. If you can’t afford to eat you can’t achieve any potential you might have. Financial stability is a gamechanger for everyone.
- ionelaipatioaei 2mo agoThat's stupid, if you're truly talented you'll solve the financial stuff in order to pursue whatever you want to do - if you don't then that's on you.
- diddid 2mo agoThis is where the DGX spark makes up a bit of the ground it loses on llm work, diffusion and cuda go together like peanut butter and jelly.
- embedding-shape 2mo agocough DiffusionGemma cough Seriously, very dumb model compared to what you can run locally, but holy moly is it FAST on one GPU, seriously impressive. Can't wait for those to be scaled up a bit to fit perfectly within 96GB VRAM, then they'll be competitive.
- tipiirai 2mo agoI'd love to know what the alternatives are and how this is better
- v-mdev 2mo agoI totally agree with you.
- Schiendelman 2mo agoThis will be a little faster right now on an M4 or M5 because it's optimized for Apple Silicon. Assuming this model is still state of the art in six months, which might not be a surprise given how long other video models have taken, this should be much, much faster with the M7 chip.
- songhonglei1985 2mo ago[dead]
- antirez 2mo agoIn the AMA Minimax said that H3 could support sparse attention, that would be a huge speedup! I wonder if there are any news on that. H3 is very cool. EDIT: testing a --sparse-attention optional mode based on what they said in the Reddit post.
- linzhangrun 2mo agoOn my 128GB M4 Max Mac Studio, generating a 15s 480p video with MiniMax H3 in ComfyUI takes an hour and a half. Put Codex to work on deploying it now, hoping the speed can improve quite a lot :-) Thanks anyway
- sscarduzio 2mo agoPlease keep up posted about the results!
- linzhangrun 2mo agoFirst batch of quick test results: approximately 1/5 speed improvement
- bewareofscams 2mo ago+20% or x5 speed improvement?
- linzhangrun 2mo ago20%
- embedding-shape 2mo ago> On my 128GB M4 Max Mac Studio, generating a 15s 480p video with MiniMax H3 in ComfyUI takes an hour and a half. That's crazy, a RTX Pro 6000 does that in in 2-3 minutes (give or take, depending on your exact settings). LLMs don't make the difference between standalone GPU vs unified memory + CPU so obvious as diffusion models seems to do.
- whywhywhywhy 2mo agoIt’s always been the case, it’s more the anomaly that LLMs work at comparable speeds on M series because almost all other ML runs way faster on Nvidia cards.
- yieldcrv 2mo agoAlright I’ve been afraid to ask but have been having trouble finding What are some adult entertainment workflows in comfyui, I need best loras, best prompts to start with and the communities, are they on telegram or something?
- bahmboo 2mo agoThis is a healthy question. We want to use these tools for regular old human needs and desires.
- Havoc 2mo agoThere will Reddit subs for it though couldn’t tell you which off top of my head I’d personally steer clear of messaging platforms for this - who knows what one might stumble into there
- embedding-shape 2mo ago> I’d personally steer clear of messaging platforms for this - who knows what one might stumble into there Personally I have no interest, but sometime browse stuff out of curiosity. But this got more of my curiosity, what kind of "stuff" are you implying they might stumble upon on the open, public internet? Sure, some NSFW, horror and otherwise weird stuff is there, especially around AI generation, but hardly something that will leave you traumatized, unless I misunderstand what you're implying?
- Havoc 2mo agoI do not know and very much plan to keep it that way
- Nekit1234007 2mo agoOne thing I read on this topic on reddit is never EVER use the word "girl" when prompting H3. So CSAM probably.
- embedding-shape 2mo ago
- myshapeprotocol 2mo ago[flagged]
- iamyatin 2mo agoNoob question to all, is there any open source coding model that I can run on Mac mini 16gb?
- luciana1u 2mo ago[flagged]
- aaqaishtyaq 2mo agoAnyone tried it with M4 Pro, 48GB of memory?
- GangstaAgents 2mo ago[dead]
- sharanharsoor 2mo agohey, this is nice!
- thedangler 2mo agoI'm looking to setup a way to create images for my own instagram marketing. I do not care how long it takes to make 10 variations of a post as that speed would still be faster than me making it. Does this model work with ComfyUI easily? Can I just download it?
- tracerbulletx 2mo agoYes, there's a default workflow template in Comfy for that matter now.
- bewareofscams 2mo agoHow long to generate a 10-sec 1920x1080 vid on Mac M4 64GiB?
- purplemoonx 2mo ago[flagged]
- ChristmasTomer 2mo agoI mean yeah, a 5090 is obviously gonna smoke a Mac lol. But that’s not really the point. If I can run this thing locally and get a video in a few minutes instead of an hour, that’s already pretty sick.
- benbojangles 2mo agorunning this on an m1 max 64gb, it produces some really nice clips with music and audio, stitching the clips together after makes a nice short story generated entirely using a local ai system. It takes quite a while to generate each clip though, But at least it is working. I would like to know a few things: -Optimal settings/configs examples for h3.c to help speed things up -Optimal recommended generation settings for each mac product, i am sure it is easy to do -Prompt generator assistant Great work from the github author. The more i use it the more i realise i don't need a gui to generate video, just terminal. My setup: Macbook #1 as a client Macbook #2 as server -use macbook #1 terminal + ssh -run mactop in terminal tab to monitor Macbook #2's hardware during ai video generation -run h3.c on Macbook #2 via ssh session -transfer the output video file from macbook #2 to macbook #1 using terminal scp -view the video