5 ms·
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior
- LarsDu88 3y agoThis is incredible. All that remains is a network for rigging (and maybe retopology) Indie gamedev would be revolutionized
- Benjaminsen 3y agoLike this? https://anything.world/ https://anything.world/
- kleiba 3y agoThere would still be a long way to go, I believe. Creating a consistent art style, with assets that fit into each other well for a whole game world would still be very challenging, for example.
- reactordev 3y agoWe are definitely getting warmer. Exciting times. I would love a metahuman like diffusor for my characters. This would also be great for quickly generating props from photos or midjourney conjures. I still feel like all of these techniques and tools still require an artist, but the artists job is now more macro than at the micro. Awesome!
- byteknight 3y agoWhat causes all of these papers published on github without code?
- echelon 3y agoMassive receptive AI audience. The papers published on GitHub are typically presented in a much more accessible and beautiful way than arXiv. The downstream social traction is further signal and affirmation for your results, lab, and/or company.
- smusamashah 3y agoThere is also Zero123++ which seems to be doing the same thing but has code available https://github.com/SUDO-AI-3D/zero123plus https://github.com/SUDO-AI-3D/zero123plus EDIT: Just realized this one only outputs multiple images which are 3D consistent, not a 3d model.
- rprenger 3y agoI believe Zero123++ gives you the ability to generate consistent images from multiple camera views, where as DreamCraft3D seems to output 3D models with geometry and textures if I'm understanding it right. Like I could take the output of DreamCraft3D (if I had the code) and drop the result into Blender for example.
- T-A 3y agoIt is not unusual for code release to follow paper release with a lag of days to weeks. The top priority for a researcher is to get the paper out. Code is supporting material of secondary importance.
- livrem 3y agoI was wondering why all of those papers have PDF downloads with the most useless, non-descriptive, names. > Paper_high_res.pdf
- menacingly 3y agoProbably the same kind of oversight that just allowed me to compile hundreds of books in a catalog each as "book.pdf" It was on exactly the second download where I realized how restrictive my choice of namespace was
- corysama 3y agoThe authors aren't thinking about you when they name the 87th revision of their paper.pdf They just want to get some sleep.
- alok-g 3y agoI used to give descriptive names to directories that would each carry a main document, and associated materials like references, diagrams, etc. Since the directory already had a descriptive name, I used to name the main document like "-- paper.docx" so that it stays on top when sorting the files by name. However, realizing the problem you have mentioned, I started giving descriptive names to the main document also, in most cases by re-using the name given to the directory, still adding the leading "--".
- scoopertrooper 3y agoThe fourth line of the readme > Code will come soon.
- reactordev 3y agoProof is in the pudding, so to speak.
- deleted 3y ago[deleted]
- echelon 3y agoUnlike other areas of AI that are immediately applicable to use in products (LLMs, Stable Diffusion, RVC, etc.), 3D sculpting has years of further optimization before it finds its fit. These sculpts are not "game ready". Their object geometry is massively bloated and inefficient. They're not rigged with a skeleton or morph targets. That's a hard problem that some products (like rigify) can sort of solve, but not for assets in this poor shape. The massive VC funds being poured into this "game ready asset AI" should sit on the sideline for 3-4 years and invest in a new player with a fresh cap table and no baggage. I'm looking to jump into this area, but the timing is off.
- dleeftink 3y agoBut isn't the point of publishing intermediate results to present what is currently possibly and set the agenda for future inquiries?
- andybak 3y ago> Their object geometry is massively bloated and inefficient. This came out recently which looks like a leap forward in optimization: https://github.com/nv-tlabs/FlexiCubes https://github.com/nv-tlabs/FlexiCubes
- danielvaughn 3y agoI mean, alternatively, the timing is now. It's a great time to get a head start on it, because once it hits market-readiness, there are going to be massive opportunities.
- Mizza 3y agoThis is very impressive, the best one in the space I've seen, although I'd like to see some of the less cherry-picked examples.
- cgijoe 3y agoYup, I had the same thought. Click through the gallery to the last page, and you can start to see artifacts in the examples. The chicken & waffles one particularly. Although I must say, I am still extremely impressed by this tech.
- broast 3y agoInterestingly most of the artifacts, like the chicken and waffles one, are on the texture and not on the mesh.
- deleted 3y ago[deleted]
- dragonwriter 3y agoSo, at the code link > Code will come soon. Disappointing, but also: > 6 forks That's... eager.
- deleted 3y ago[deleted]
- kookamamie 3y ago"soldier cat" - the model shows a dog.
- deleted 3y ago[deleted]
- TaylorAlexander 3y agoThis one? That's a cat my friend. https://mrtornado24.github.io/DreamCraft3D/assets_dreamcraft3d/videos/cat_soldier.mp4 https://mrtornado24.github.io/DreamCraft3D/assets_dreamcraft...
- DonHopkins 3y agoThat's a cow! https://www.youtube.com/watch?v=10JSPdTDFsI https://www.youtube.com/watch?v=10JSPdTDFsI
- spandextwins 3y agoYou know how many of these bullshit things we’ve had in the past year? Lots. All of them promise something, have a long (maybe even AI generated) research paper. And,, most of all, NO CODE. Wtf. Push your code. Or slse it doesn’t exist. I have a ton of these bookmarked. Still waiting for code. I call bullshit.
- kristopolous 3y agoI think you'll soon be wrong on this one based on the owners other projects https://github.com/MrTornado24 https://github.com/MrTornado24 All the rest have code. I'd expect to see it coming here in a few days
- issam1975 3y agoAny ETA for releasing the source code please . i would love to test this for my current game project .