compression

Specialized compressors

To compress bin/cue more efficently, prepass with unecm. To compress multiple similar .zip/.iso files more efficiently (e.g. Cyanogen / Windows operating system images), prepass with precomp, then deduplicate+compress with zpaq. Or, prepass with precomp, deduplicate with srep, and finally compress with xz/7z.

Recompressing enwiki

Abstract I download wikipedia database dumps on a semi-regular basis in case of transient internet outages. The file enwiki-latest-pages-articles of 2014-02-21 arrives as an xml.bz2. Is it worth recompressing it? Results size pct ctime dtime uncompressed 47 078 573 765 100.0% - - quicklz 19 691 063 966 41.8% 13m wikitaxi 17 131 739 126 36.4% 2h24m - rar-fastest 13 817 152 272 29.
Read more