4 ms·
This (feature or attention maps) is BS. A real explanation would show what factors were being used to make the determination. Claiming the model is "looking at"
by andy99 3y ago
This (feature or attention maps) is BS. A real explanation would show what factors were being used to make the determination. Claiming the model is "looking at" something has no explanatory power. We already knew it was looking at the picture. These heat maps are great for showing people what they want to see and making wishy washy claims like this but they really don't explain anything in the commonly understood sense of telling us what is different.
- MarkusQ 3y agoI disagree. It clearly tells us _what_ is different, it just doesn't tell us _how_ it differs from case to case. So it's not a full explanation (which would, as you note, require a model of how it differs and, optimally, _why_) but it is a step towards a explanation, and not to be sneered at.