Of course, which is why gzip is a good baseline for "better" compressors that do have semantic understanding. The whole idea of an autoencoder is conceptual co

Of course, which is why gzip is a good baseline for "better" compressors that do have semantic understanding. The whole idea of an autoencoder is conceptual compression. You take a concept (say: human faces) and create a compressor that is so overfit to that concept that when given complete goobldygook (random seed data) it decompresses that to something with semantic meaning!