7 ms·
Hunyuan3D-2-Turbo: fast high-quality shape generation in ~1s on a 4090
- dvrp 2y agoSee also: https://github.com/Tencent/FlashVDM https://github.com/Tencent/FlashVDM
- tetrisgm 2y agoCan we see meshes, exports in common apps as examples? This looks better than the other one on the front page rn
- dvrp 2y agoAgree. That's why I posted it; I was surprised people were sleeping on this. But it's because they posted something yesterday and so the link dedup logic ignored this. This is why I linked to the commit instead. There are meshes examples on the Github. I'll toy around with it.
- llm_nerd 2y agoGenerate some of your own meshes and drop them in Blender. https://huggingface.co/spaces/tencent/Hunyuan3D-2 https://huggingface.co/spaces/tencent/Hunyuan3D-2 The meshes are very face-rich, and unfortunately do not reduce well in any current tool [1]. A skilled Blender user can quickly generate better meshes with a small fraction of the vertices. However if you don't care about that, or if you're just using it for brainstorming starter models it can be super useful. [1] A massive improvement in the space will be AI or algorithmic tools which can decimate models better than the current crop. Often thousands of vertices can be reduced to a fraction with no appreciable impact in quality, but current tools can't do this.
- kilpikaarna 2y agoThere's Quad Remesher (integrated in C4D and ZBrush as ZRemesher). It's proprietary but quite affordable ($109 for a perpetual commercial license or $15/month -- no, not affiliated). No AI, just clever algorithms. I'm sure there are people trying to train a model to do the same thing but jankier and more unpredictable, though.
- llm_nerd 2y agoIt's an interesting project and seems to work superbly on human created topographies, but in some testing with outputs of Hunyuan3D v2, it is definitely a miss. It is massively destructive to the model and seems to miss extremely obvious optimizations of the mesh while destroying the fidelity of the model even at very low reduction settings. Something about the way this project generates models does not mesh, har har, with the algorithms of Quad Remesher.
- boppo1 2y agoCan it run on a 4080 but slower, or is the vram a limitation?
- dvrp 2y agoThey don't mention that and I don't have one — can you try for yourself and let us know? I think you can get it from Huggingface or GH @ https://github.com/Tencent/Hunyuan3D-2 https://github.com/Tencent/Hunyuan3D-2
- fancyfredbot 2y agoThey mention "It takes 6 GB VRAM for shape generation and 24.5 GB for shape and texture generation in total." So based on this your 4080 can do shape but not texture generation.
- boppo1 2y agoNnice, that's all i needed anyway.
- thot_experiment 2y agoalmost certainly, i haven't tried the most recent models but i have used hy3d2 and hy3d2-fast a lot and they're quite light to inference. You're gonna spend more time decoding the latent than you will inferencing. Takes about 6gb vram on my machine, I can't imagine these will be heavier.
- llm_nerd 2y agoIt can run on a 4080 if you divide and conquer. I just ran a set on my 3060 (12GB), although I have my own script which does each step separately as each stage uses from 6 - 12GB of VRAM. -loads the diffusion model to go from text to an image and then generate a varied series of images based upon my text. One of the most powerful features of this tool, in my opinion, is text to mesh, and to do this it uses a variant of Stable Diffusion to create 2D images as a starting point, then returning to the image to mesh pipeline. If you already have an image this part obviously isn't necessary. -frees the diffusion model from memory. Then for each image I- -load the image to mesh model, which takes approximately 12GB of VRAM. Generate a mesh -free the image to mesh model -load the mesh + image to textured mesh model. Texture the mesh -free the mesh + image to textured mesh model It adds a lot of I/O between each stage, but with super fast SSDs it just isn't a big problem.
- fixprix 2y agoI recently got into creating avatars for VR and have used AI to learn Unity/Blender so ridiculously fast, like just a couple weeks I've been at it now. All the major models can answer basically any question. I can paste in screenshots of what I'm working on and questions and it will tell me step by step what to do. I'll ask it what particular settings mean, there are so many settings in 3d programs; it'll explain them all and suggest defaults. You can literally give Gemini UV maps and it'll generate textures for you, or this for 3d models. It feels like the jump before/after stack overflow. The game Myst is all about this magical writing script that allowed people to write entire worlds in books. That's where it feels like this is all going. Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it.
- anonzzzies 2y agoYou tried sharing your screen with Gemini intead of screenshots? I found it sometimes is really brilliant and sometimes terrible. It's mostly a win really.
- fixprix 2y agoI just tried it for the first time and it was a pretty cool experience. Will definitely be using this more. Thanks for the tip!
- baq 2y agoLook up blender and unity MCP videos. It’s working today.
- fixprix 2y agoWatching a video on it now, thanks!
- ForTheKidz 2y ago> The game Myst is all about this magical writing script that allowed people to write entire worlds in books. That's where it feels like this is all going. Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it. This is probably the first pitch for using AI as leverage that's actually connected with me. I don't want to write my own movie (sounds fucking miserable), but I do want to watch yours!
- deleted 2y ago[deleted]
- sruc 2y agoNice model, but strange license. You are not allowed to use it in EU, UK, and South Korea. “Territory” shall mean the worldwide territory, excluding the territory of the European Union, United Kingdom and South Korea. You agree not to use Tencent Hunyuan 3D 2.0 or Model Derivatives: 1. Outside the Territory;
- Eduard 2y agosource: https://github.com/Tencent/Hunyuan3D-2/blob/main/LICENSE https://github.com/Tencent/Hunyuan3D-2/blob/main/LICENSE
- johaugum 2y agoMeta’s Llama models (and likely many others') have similar restrictions. Since they don’t fully comply with EU AI regulations, Meta preemptively disallows their use in those regions to avoid legal complications: “With respect to any multimodal models included in Llama 3.2, the rights granted under Section 1(a) of the Llama 3.2 Community License Agreement are not being granted to you if you are an individual domiciled in, or a company with a principal place of business in, the European Union. This restriction does not apply to end users of a product or service that incorporates any such multimodal models” https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/USE_POLICY.md https://github.com/meta-llama/llama-models/blob/main/models/...
- littlestymaar 2y agoThis is merely a “we don't take responsibility if this somehow violates EU rules around AI”, it's not something they can enforce in any way. But even as such a strategy, I don't think that would hold if the Commission decided to fine Tencent for releasing that in case it violated the regulation. IMHO it's just the lawyers doing something to please the boss who asked them to “solve the problem” (which they can't, really).
- ForTheKidz 2y agoProbably for domestic protection more than face value. Western licenses certainly have similar clauses to protect against liability for sanction violations. It's not like they can actually do much to prevent the EU from gaining from it. North Korea? Maybe. Uk? Who gives a shit
- lwansbrough 2y agoHow long before we start getting these rigged using AI too? I’ve seen a few of these 3D models so far but none that do rigging.
- halkony 2y agoThis is what I'm looking forward to the most, there's a lot of potential for virtual reality with these models.
- bufferoverflow 2y agohttps://anything.world/ https://anything.world/
- qingcharles 2y agoThis looks great!
- Y_Y 2y agoHow are they extracting value here? Is this just space-race-4-turbo propagandising? I see plenty of GitHub sites that are barely more than advertising, where some company tries to foss-wash their crapware, or tries to build a little text-colouring library that burrows into big projects as a sleeper dependency. But this isn't that. What's the long game for these companies?
- yimby2001 2y agoWhat is the long game for tencent?
- Y_Y 2y agoMaybe it was unclear, but that's what I'm asking too.
- yowlingcat 2y agoThere's an old Joel Spolsky post that's evergreen about this strategy -- "commoditize your complement" [1]. I think it's done for the same reason Meta has made llama reasonably open -- making it open ensures that a proprietary monopoly over AI doesn't threaten your business model, which is noteworthy when your business model might include aggregating tons of UGC and monetizing engagement over it. True, you may not be able to run the only "walled garden" around it anymore, but at least someone else can't raid your walled garden to make a new one that you can't resell anymore. That's the simplest strategic rationale I could give for it, but I can imagine deeper layers going beyond that. https://www.joelonsoftware.com/2002/06/12/strategy-letter-v/ https://www.joelonsoftware.com/2002/06/12/strategy-letter-v/
- quitit 2y agoRunning my usual img2mesh tests on this. 1. It does a pretty good job, definitely a steady improvement 2. The demos are quite generous versus my own testing, however this type of cherry-picking isn't unusual. 3. The mesh is reasonably clean. There are still some areas of total mayhem (but these are easy to fix in clary modelling software.)
- amelius 2y agoI don't understand why it is necessary to make it this fast.
- Philpax 2y agoIt helps with iteration - you can try out different concepts and variations quickly without having to wait, especially as you refine what you want and your understanding of what it's capable of. Also, in general, why not?
- amelius 2y ago> Also, in general, why not? There are various reasons: - Premature optimization will take away flexibility, and will thus affect your ability to change the code later. - If you add features later that will affect performance, then since the users are used to the high performance, they might think your code is slow. - There are always a thousands things to work on, so why spend effort on things that users, at this point, don't care much about?
- andybak 2y ago> users, at this point, don't care much about? What makes you think this is true?
- TeMPOraL 2y agoBeing this fast is not a "premature optimization", it's a qualitatively different product category. ~immediate feedback vs. long wait time enables entirely different kinds of working. Also: > since the users are used to the high performance, they might think your code is slow. I wouldn't worry about it in general - almost all software is ridiculously slow for the little it can do, and for the performance of machines it runs on, and it still gets used. Users have little choice anyway. In this specific case, if speed is makes it into a different product, then losing that speed makes the new thing... a different product. > There are always a thousands things to work on, so why spend effort on things that users, at this point, don't care much about? It's R&D work, and it's not like they're selling it. Optimizing for speed and low resource usage is actually a good way to stop the big players from building moats around the technology, and to me, that seems like a big win for humanity.
- awongh 2y agoWhat's the best img2mesh model out there right now, regardless of processing requirements? Are any of them better or worse with mesh cleanliness? Thinking in terms of 3d printing....
- MITSardine 2y agoFrom what I could tell of the Git repo (2min skimming), their model is generating a point cloud, and they're then applying non-ML meshing methods on that (marching cubes) to generate a surface mesh. So you could plug any point-cloud-to-surface-mesh software in there. I wondered initially how they managed to produce valid meshes robustly, but the answer is not to produce a mesh, which I think is wise!
- coolius 2y agohas anyone tried to run this on apple silicon yet?
- postalrat 2y agoThat would be revolutionary.
- debbiedowner 2y agoHas anyone tried it on a 3090?
- manjunaths 2y agoI tried it on my Radeon 7900 GRE 16GB on Windows 11 WSL Ubuntu 24.04 with torch 2.4.0 and rocm 6.3.4, from here, https://repo.radeon.com/rocm/manylinux/rocm-rel-6.3.4/ https://repo.radeon.com/rocm/manylinux/rocm-rel-6.3.4/. I am impressed, it runs very fast. Far faster than the non-turbo version. But the primary time is being spent on the texture generation and not on the model generation. As far as I can understand this speeds up the model generation and not the texture generation. But impressive nonetheless. I also took a head shot of my kid and ran it through https://www.adobe.com/express/feature/ai/image/remove-background https://www.adobe.com/express/feature/ai/image/remove-backgr... and cropped the image and resized it to 1024x1024 and it spit out a 3d model with texture of my kid. There are still some small artifacts, but I am impressed. It works very well with the assets/example_images. Very usable. Good work Hunyuan!