4 ms·
The future may be ~ AI-assisted format detection + OpenZL (~ OpenZL-AI-LLM recognises the data structure, then guides OpenZL toward the best lossless compressi
by pella 4mo ago
The future may be ~ AI-assisted format detection + OpenZL
(~ OpenZL-AI-LLM recognises the data structure, then guides OpenZL toward the best lossless compression path )
- mike_hock 4mo ago1. Upload data using conventional compression method (or uncompressed) 2. Spend orders of magnitude (literally) more on compute to run the LLM on the data than any compression algorithm would ever take.
- deleted 4mo ago[deleted]
- pella 4mo ago"The unreasonable effectiveness of our first foray into training leads us to believe that the graph model is uniquely positioned to facilitate ML-guided generation of compressors. We are tempted to view this as “the next big thing” in production-scale compression. Whereas compression research has up to now eluded those without domain expertise, we believe the future of application-specific compressors will be unlocked via investment in automated learning methods." https://arxiv.org/abs/2605.09928 https://arxiv.org/abs/2605.09928 [11 May 2026] OpenZL: Using Graphs to Compress Smaller and Faster