3 ms·

The linked post demonstrates arbitrary re-ordering of image patches. Spatial continuity is not relevant to neural networks.

• bonoboTP 1y ago
  That's ridiculous, sorry. If that were so, we wouldn't have positional encodings in vision transformers.
  • measurablefunc 1y ago
    It's not ridiculous if you understand how neural networks actually work. Your perception of the numbers has nothing to do w/ the logic of the arithmetic in the network.
    • bonoboTP 1y ago
      Do you know what "positional encoding" means?
      • measurablefunc 1y ago
        Completely irrelevant to the point being made.