4 ms·

An AI that does good UV unwrapping would be much more interesting and useful.

by bno1 4y ago

rytill 4y ago
Can you help me understand how you are imagining that? As in, you have texture images already and you want to apply them to the 3D object intelligently? Is that the case you’re talking about? Or texture generation and UV unwrapping in one?
- caenorst 4y ago
  I think what they mean by UV unwrapping is generating a UV map from. Textured model (here the texture is generated by a triplanes network). It’s interesting for compression purpose, but kinda orthogonal to this method (a good UV unwrapping can be used once the model generated)
- bno1 4y ago
  Generating an UV map from an untextured mesh. The UV map is stored in vertices as texture coordinates, and together with the topology of the mesh it defines how the texture (images) gets mapped to the mesh. A good UV maps preserve surface area (e.g. every region of the mesh map to regions of the texture proportionally, otherwise you get stretching), have few seams and have little empty space around the texture to reduce size. There are ways to do this automatically but they're far from perfect. Artists usually take the mesh and literally unwrap it until it's planar, and convert this transformed mesh to the UV mapping. The advantage of this method is that it gives you very good control of seams and texture islands, but it's tricky to preserve surface area. Those neural rendering methods are very cool because they use light/color fields, but they still have a lot of catching up to do compared to modern 3D graphics.
smoldesu 4y ago
And I'd love to see an AI-generated rigging tool for auto-generating bone structures so you don't have to do it by hand. Baby steps, though. The data required to train an unwrapping/rigging tool is a lot more domain-specific than correlating an OBJ file with it's completed render.
stavros 4y ago
I think this is a bit of a useless comment. Someone made a cool thing, and the reply is "I can think of a cooler thing"? I mean, yeah, I can always think of cooler things, but now we have this cool thing so saying that it's not as cool as some other thing that can exist doesn't add anything to the conversation.

An AI that does good UV unwrapping would be much more interesting and useful.

by bno1 4y ago

An AI that does good UV unwrapping would be much more interesting and useful.

Can you help me understand how you are imagining that? As in, you have texture images already and you want to apply them to the 3D object intelligently? Is that the case you’re talking about? Or texture generation and UV unwrapping in one?

caenorst 4y ago
I think what they mean by UV unwrapping is generating a UV map from. Textured model (here the texture is generated by a triplanes network). It’s interesting for compression purpose, but kinda orthogonal to this method (a good UV unwrapping can be used once the model generated)
bno1 4y ago
Generating an UV map from an untextured mesh. The UV map is stored in vertices as texture coordinates, and together with the topology of the mesh it defines how the texture (images) gets mapped to the mesh. A good UV maps preserve surface area (e.g. every region of the mesh map to regions of the texture proportionally, otherwise you get stretching), have few seams and have little empty space around the texture to reduce size. There are ways to do this automatically but they're far from perfect. Artists usually take the mesh and literally unwrap it until it's planar, and convert this transformed mesh to the UV mapping. The advantage of this method is that it gives you very good control of seams and texture islands, but it's tricky to preserve surface area. Those neural rendering methods are very cool because they use light/color fields, but they still have a lot of catching up to do compared to modern 3D graphics.

smoldesu 4y ago

And I'd love to see an AI-generated rigging tool for auto-generating bone structures so you don't have to do it by hand. Baby steps, though. The data required to train an unwrapping/rigging tool is a lot more domain-specific than correlating an OBJ file with it's completed render.

stavros 4y ago

I think this is a bit of a useless comment. Someone made a cool thing, and the reply is "I can think of a cooler thing"? I mean, yeah, I can always think of cooler things, but now we have this cool thing so saying that it's not as cool as some other thing that can exist doesn't add anything to the conversation.