3 ms·
> And you’re not gonna get great compression if a lot of the files are tiny. The future of compression is likely shared dictionaries, basically recognize the f
by bhouston 2y ago
> And you’re not gonna get great compression if a lot of the files are tiny.
The future of compression is likely shared dictionaries, basically recognize the file type and then use a dictionary that is optimized for that file type. E.g. JavaScript/TypeScript or HTML or Rust or C++, etc. That can offset the problems with small files to a large degree.
But again, this is a complex problem and it should be dealt with orthogonally to npm in my opinion.
I also checked and it should be possible for npm to enable file system compression at the OS level on both Windows and MacOS.
Also if it was dealt with orthogonally to npm, then it could be used by pip, and other package systems.