The original paper examines some likely causes for failure to encode relational details between subjects, e.g. the corgi with a red hat and green necktie or vic

The original paper examines some likely causes for failure to encode relational details between subjects, e.g. the corgi with a red hat and green necktie or vice versa chosen seemingly at random. The model seems to learn about contrasting subjects but not track particularly which attributes belong to which subjects. This is, as far as I can tell from the original paper, inherent in the training and would require different data sets or more parameters to learn a greater number of subject-attribute associations in each image. https://arxiv.org/abs/2204.06125 https://arxiv.org/abs/2204.06125