3 ms·

When I say "what are you supposed to do" I'm speaking from the perspective of an end-user, in this case an artist trying to animate a 3D asset. With traditional

When I say "what are you supposed to do" I'm speaking from the perspective of an end-user, in this case an artist trying to animate a 3D asset. With traditional 3D workflows all of the parameters are in the open, if something doesn't match the desired result it can be tweaked until it does, down to the most minute detail. With this NeRF workflow however, if the NNs aren't cooperating then all the user can do is raise it to someone else and wait to hopefully get a better NN back at some point. I'm just struggling to see what NeRFs bring to the table over existing workflows for it to be worth dealing with fuzzy logic - it seems like a solution looking for a problem. I guess if you just don't care about the details of what you're making then AI could lower the barrier to producing something mediocre, as it has with 2D image generation, but that's damning with faint praise.

zokier 3y ago
> I guess if you just don't care about the details of what you're making then AI could lower the barrier to producing something mediocre, as it has with 2D image generation, but that's damning with faint praise. To me this sounds a lot like how people complained in 80s(?) about compilers generating worse code than expert assembly programmers. Yes, it is true, but also quantity can trump quality. And allowing machine to do bulk work, even if mediocre, allows humans to focus on key parts; in code some hot kernels, in 3d modeling maybe some hero assets. Also like compilers have evolved lot in the past decades, I don't see reason why these ML models/NNs/etc could not improve on a similar trajectory. Note that I'm not saying that they inevitably will improve to superhuman levels, but just that at this point they don't seem something that can be completely dismissed. Furthermore I don't think it's faint praise if tool can enable non-experts to create compelling 3D experiences easily even if they are not perfect and photorealistic. Again I draw parallels to programming; lowering the skill level needed has allowed huge amount of valuable programs to be written even if the code behind them is complete crap
kajecounterhack 3y ago
This is a matter of ergonomics and how close this thing is to production readiness; there's no reason the neural-net approach couldn't evolve and open up the parameters you want to tweak. Neural nets are just functions after all. You can refactor functions to expose params. Without being an expert in this area, I imagine one such way would be to train a second neural net that learns to regress traditional workflow parameters to best approximate the NeRF output, then let a user post-edit those parameters to fine-tune.

zokier 3y ago

> I guess if you just don't care about the details of what you're making then AI could lower the barrier to producing something mediocre, as it has with 2D image generation, but that's damning with faint praise. To me this sounds a lot like how people complained in 80s(?) about compilers generating worse code than expert assembly programmers. Yes, it is true, but also quantity can trump quality. And allowing machine to do bulk work, even if mediocre, allows humans to focus on key parts; in code some hot kernels, in 3d modeling maybe some hero assets. Also like compilers have evolved lot in the past decades, I don't see reason why these ML models/NNs/etc could not improve on a similar trajectory. Note that I'm not saying that they inevitably will improve to superhuman levels, but just that at this point they don't seem something that can be completely dismissed. Furthermore I don't think it's faint praise if tool can enable non-experts to create compelling 3D experiences easily even if they are not perfect and photorealistic. Again I draw parallels to programming; lowering the skill level needed has allowed huge amount of valuable programs to be written even if the code behind them is complete crap

kajecounterhack 3y ago

This is a matter of ergonomics and how close this thing is to production readiness; there's no reason the neural-net approach couldn't evolve and open up the parameters you want to tweak. Neural nets are just functions after all. You can refactor functions to expose params. Without being an expert in this area, I imagine one such way would be to train a second neural net that learns to regress traditional workflow parameters to best approximate the NeRF output, then let a user post-edit those parameters to fine-tune.