Fair enough, though the reason I posted was because the GP did get cheddar misclassified as comte so it evidently can propose both comte and gruyere as labels.

Fair enough, though the reason I posted was because the GP did get cheddar misclassified as comte so it evidently can propose both comte and gruyere as labels. Maybe the taxonomy could be revised to make it respond gruyere/compte if they are really indistinguishable. Where I am, comte is usually wider than gruyere. If this generally holds, that could be what it uses to distinguish them, and actually I showed it a cut piece so maybe that's why it thought gruyere. With more time / motivation, it would be interesting to do a study looking at whether size and orientation can change the predicted label. Like if I cut cheddar into a wedge would it think its brie?