3 ms·
Fundamentally, you can't solve vision in the abstract. It needs to be tied to a concrete problem. With requirements that describe the operating environment and
by w_t_payne 7y ago
Fundamentally, you can't solve vision in the abstract.
It needs to be tied to a concrete problem. With requirements that describe the operating environment and properties that need to be inferred from the image.
- GistNoesis 7y agoYes I agree. You need to infer the position about the camera parameters, and need to infer the position about objects and their poses. It's just that differentiating a complex renderer to search for the minimum is an inefficient way to infer the them. It's better for optimization purposes to train an as simple as possible differentiable rendering model to match the rendering of your complex renderer as a target (so in practice you never need its gradients), and use the gradient provided by this model to search for poses and camera parameters. It's even better if you can train an invertible rendering model so you can infer the poses and parameters in single step. (The same way that style transfer is done).