3 ms·
The training data is just billions of {RGB image, text description} pairs. So, it appears the model figured out how to make the normals as part of the process o
by corysama 3y ago
The training data is just billions of {RGB image, text description} pairs. So, it appears the model figured out how to make the normals as part of the process of making the images.
Or, are you asking how the researchers extracted it?
> I-LoRA modulates key feature maps to extract intrinsic scene properties such as normals, depth, albedo, and shading, using the models' existing decoders without additional layers, revealing their deep understanding of scene intrinsics.
- auggierose 3y agoYes, that sentence "modulates key feature maps" doesn't tell me anything. What do they mean when saying they extract the normals?