3 ms·
Something…seems fishy? Like the example with the guy next to the robot figure. Their model happened to predict exactly the same type of figure?! Diffusion model
by syntaxing 3y ago
Something…seems fishy? Like the example with the guy next to the robot figure. Their model happened to predict exactly the same type of figure?! Diffusion models are not omnipotent…
- IshKebab 3y agoThat's the entire point. It didn't "happen" to predict exactly the same type of figure. It used the context photos to know what type of figure it should render. You might be getting a bit confused because here the training process has to happen every time you use it, whereas in most AI applications you only perform inference for actual use.
- bjornlouser 3y agoI wonder if he is holding that umbrella to aid the model in recovering the 3d scene/scale from the reference images.
- foota 3y agoThe model gets the reference images as "context", so it can just copy the robot from one of the other images.
- syntaxing 3y agoAhh I see, this makes a lot more sense now!