4 ms·
Why was the download 3gb, if the solution created a 300x reduction primarily by sharing suffixes? Wouldn’t vanilla compression have dealt with that and achieved
by cadamsdotcom 5mo ago
Why was the download 3gb, if the solution created a 300x reduction primarily by sharing suffixes? Wouldn’t vanilla compression have dealt with that and achieved a decent (not ideal) amount of compression of the database?
- andriy_koval 5mo agoI think there is no vanilla compression in SQLite.
- woadwarrior01 5mo agoThere's a commercial extension that can do this. https://sqlite.org/com/cerod.html https://sqlite.org/com/cerod.html
- Arcuru 5mo agoBut there's probably not encryption either, so the sqlite database file probably has a lot of duplicated data inside it that's visible externally. I'm also curious how well it compresses by just running the sqlite file through a compression tool. I don't know enough about sqlite storage internals to guess.