                                The Art
                              of Lossless
                           Data Compression
                                vol. 26b

Here are the results of tests performed in December 2003 to compare
lossless compression of "binary" files by all known good enough programs
developed for such purpose, including UHArc, PPMd, Bzip2, RAR, ACE and 7-zip.

See Archive Comparison Test by J.Gilchrist for more details:
http://compression.ca

If anybody wants to start or continue such tests,
or can suggest some other sets of files, or other compression programs,
 (not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
 (some new fantastic technology, an algorithm or even a program capable
 of lossless compression of up to 1000:1 etc.)
please let us know immediately: artest@inbox.ru   Thank you!


[[1]] COMPRESSION QUALITY
=========================
             (see also
             [[2]] Speed
             [[3]] Details
             [[4]] Comments)

Last eleventh line shows results for the sum of all 5960 files in ten sets.

Origin  PAQ6   DURILCA  Slim   Entropy  UHArc Compressia PPMonstr  RK   7-zip 
277.57%  100%   107.52  105.05  107.87  110.34  112.89  109.40  115.43  116.84
282.61% 103.69   100%   100.40  106.85  107.59  107.00  111.37  111.71  111.49
194.75% 101.05   100%   101.16  104.00  103.67  104.57  106.16  107.35  107.39
380.63% 110.61   100%   107.93  109.76  109.25  115.18  124.38  128.93  127.91
186.22% 105.45  104.23   100%   104.45  106.01  109.66  116.04  115.74  118.99
438.28%  100%   113.36  123.00  111.51  110.40  118.53  112.67  113.22  120.51
212.37% 105.06  100.24   100%   107.18  108.81  105.47  111.09  112.05  110.98
298.93%  100%   111.78  106.59  111.49  109.19  114.79  111.81  112.74  114.12
245.18% 101.92  100.12   100%   103.41  104.86  105.01  107.39  107.80  108.37
410.77%  100%   107.62  107.78  110.52  113.58  106.39  113.48  116.40  119.11
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
256.80%  100%   100.89  101.06  104.18  104.80  105.96  108.11  109.66  110.62


 ASH     RAR   PPMN_km   SBC     BEE     ACE     PPMd   BZip2   7-zip   pkzip 
115.87  118.62  118.25  122.44  118.69  121.44  120.87  130.52  132.74  135.05
116.00  117.05  115.28  118.64  118.33  117.93  120.99  132.63  138.91  141.01
108.89  110.27  107.75  110.57  110.73  110.50  112.42  118.17  116.13  117.48
129.44  124.38  137.97  126.28  131.83  139.77  137.65  152.14  167.53  171.11
121.08  112.10  120.09  103.56  121.48  111.05  123.75  124.82  131.22  132.48
123.79  130.32  130.82  136.62  128.57  133.85  131.33  146.77  145.14  148.58
113.65  116.81  113.26  115.29  115.21  117.84  118.16  125.53  126.47  128.21
121.45  119.40  123.36  122.51  125.12  121.17  127.44  136.02  135.87  139.67
110.71  111.75  109.27  113.06  112.71  112.63  115.24  122.36  122.22  123.63
123.02  131.32  127.71  131.05  127.40  132.20  132.14  150.14  150.27  155.74
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~..~~~~~~~~~~~~~~~~~~~~~~
113.08  113.87  113.88  114.42  115.36  115.52  117.90  126.31  128.00  130.18

Results of many other programs are in full version only, BINARIES.DAT file.


[[2]] Speed
===========
4th set, all from ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/sface10.zip
was used for this test, and a 970MHz PC with 256Mb RAM and Windows98.

Programs,             Compression/    Overall    Average Users'   Compressed
options               Extraction,      Score         Score           Size
                        seconds     seconds, %    seconds, %       bytes ,  %
no compression            0     0     7613  391     7613  415    27408516  424
7za a -t7z               74     4     2684  138     2617  142     9381020  145
7za a -t7z -mx          111     4     2225  114     2125  116     7594105  117
7za a -tzip              23     1     3387  174     3366  183    12104526  187
7za a -tzip -mx          54     1     3407  175     3358  183    12062635  186
ash04a /o6 /m230        576   575     3691  189     3172  173     9140632  141
ash04a /o9 /m230        673   619     4032  207     3425  187     9860022  152
ash04a /o16 /m230       685   645     4260  219     3643  198    10543230  163
ash04a /o6 /m230 /s16   657   651     3830  197     3238  176     9075968  140
ash04a /o9 /m230 /s16   803   730     4237  217     3514  191     9730972  150
ash04a /o16 /m230 /s16  810   775     4472  230     3742  204    10387749  160
bee a -m1               187   184     3246  167     3078  168    10350726  160
bee a -m2               338   340     3331  171     3027  165     9552914  148
bee a -m3               454   464     3555  182     3146  171     9494000  147
bee a -m3 -s            667   684     3921  201     3320  181     9249655  143
durilca e -o8 -t3       214   213     2538  130     2345  128     7597450  117
durilca e -o9 -t3       216   216     2522  129     2327  127     7523916  116
durilca e -o10 -t3      218   219     2507  128     2310  126     7448698  115
durilca e -o12 -t3      221   222     2490  128     2291  125     7368195  114
durilca e -o16 -t3      226   227     2479  127     2276  124     7295306  113
durilca e -o32 -t3      239   241     2494  128     2278  124     7244957  112
durilca e -o64 -t3      374   326     2711  139     2374  129     7236704  112
durilca e -o128 -t3     489   486     2987  153     2547  139     7242413  112
epm9 c008               536   539     3483  179     3000  163     8669314  134
epm9 c012               554   557     3539  182     3040  166     8739027  135
epm9 c016               560   563     3554  182     3050  166     8750216  135
grzipii e                36    25     2831  145     2798  152     9968577  154
paq6v2a                 692   689     3881  199     3258  177     8999841  139
paq6v2a -6             1241  1496     4605  236     3488  190     6725123  104
rar a -m1                35     3     3150  162     3118  170    11203280  173
rar a -m2                38     2     3134  161     3100  169    11139927  172
rar a -m3                37     3     2538  130     2504  136     8991000  139
rar a -m4                42     3     2535  130     2497  136     8962479  138
rar a -m5                47     4     2539  130     2497  136     8957658  138
rar a -m5 -s             73     4     2373  122     2307  126     8266028  128
rar a -mc16t -s          49     5     2357  121     2313  126     8292616  128
rar a -mc16t+ -s         59    39     2478  127     2425  132     8568202  132
rar a -mc16:128t -s      49     5     2354  121     2310  126     8281923  128
rar a -mc16:128t+ -s     68    47     2400  123     2338  127     8223372  127
rar32 a -mc16t -s        51     3     2355  121     2309  126     8283248  128
rkc -mf -M230M -o8      150    17     2899  149     2764  150     9833956  152
rkc -mf -M230M -fe      150    17     2899  149     2764  150     9833956  152
slim a -d32 -w21       1928  1990     6079  312     4343  237     7774896  120
slim a -d16 -w21       1928  1985     6073  312     4338  236     7775197  120
slim a -d8 -w21        1908  1979     6047  311     4330  236     7776164  120
slim a -d4 -w21        1902  1955     6019  309     4306  235     7779001  120
uhbc e                  100    75     2932  150     2841  155     9920824  153
//previous
ace a -d4096 -m5         61     3     2608  134     2548  139     9158631  141
ace32 a                  52     3     2921  150     2869  156    10315479  159
ace32 a -d4096           56     3     2599  133     2543  138     9141767  141
ace32 a -d4096 -s-       58     3     2927  150     2868  156    10313247  159
ace32 a -d4096 -m1       47     3     2604  133     2556  139     9190071  142
ace32 a -d4096 -m5       62     3     2609  134     2548  139     9158751  141
arh a                   257   262     3694  189     3438  187    11425040  177
arh a -2 -mm            197   183     3213  165     3018  164    10196406  157
arh a -1 -mm             28     6     2986  153     2958  161    10625915  164
arh a -2 -1             304   202     3675  189     3374  184    11408516  176
ba -k -50                46    24     3016  155     2969  162    10601804  164
ba -k                    37    22     2973  152     2936  160    10487070  162
ba -k -m                 40    23     3174  163     3134  171    11197676  173
ba -k -10                38    22     2936  151     2899  158    10353984  160
boa -m1                 236   226     3623  186     3389  185    11379129  176
boa -m7                 547   485     3938  202     3396  185    10458903  162
boa -m15                690   615     4185  215     3502  191    10368786  160
boa -m15 -s             696   617     4191  215     3501  191    10359887  160
bzip2 -k                 33    10     3130  161     3097  169    11112953  172
bzip2 -k -s              29     9     3177  163     3148  171    11299261  175
bzip2 -k -1              29     8     3262  167     3232  176    11604881  179
bzip2 -k -5              31    10     3131  161     3100  169    11126137  172
bzip2 -k -9              33    10     3130  161     3097  169    11112953  172
Entropy b o12           260   274     2744  141     2486  135     7953204  123
Entropy b o16           259   277     2739  140     2482  135     7928059  122
Entropy b o32           269   286     2752  141     2485  135     7907407  122
Entropy b o64           300   307     2803  144     2505  136     7903715  122
compcl c -b15            50    42     2744  141     2693  147     9544827  147
compcl c -b15 -s         50    42     2742  141     2692  147     9540017  147
dc e                    107    13     2796  143     2690  146     9630736  149
dc e -fb                129    13     3090  158     2962  161    10610515  164
dc e -b16300            131    14     2336  120     2206  120     7888232  122
dc e -b16300 -mb5       129    14     2335  120     2206  120     7888421  122
eri a                    55    30     2781  143     2727  148     9706022  150
eri a -m3                85    38     2777  142     2693  147     9555684  148
eri a -m6                85    37     2785  143     2700  147     9582523  148
gcac a                   44    16     2897  149     2853  155    10212208  158
gcac s                   45    18     2935  150     2890  157    10337588  160
imp98 a -mm              33     1     2748  141     2715  148     9770169  151
imp98 a -mm -m3          52     1     2757  141     2704  147     9730287  150
imp98 a -mm -2           22     7     2968  152     2945  160    10577128  163
imp98 a -mm -s4          33     3     2753  141     2719  148     9775588  151
imp98 a -2 -s4           28     4     2910  149     2882  157    10359249  160
pkzip -es                 2     1     3951  203     3949  215    14212209  220
pkzip -a                  6     1     3436  176     3430  187    12347196  191
pkzip -exx                7     1     3430  176     3423  186    12320267  190
ppmdi e -o6 -m232        48    51     2941  151     2893  158    10230866  158
ppmdi e -o9 -m232        51    54     2878  148     2827  154     9980158  154
ppmdi e -o12 -m232       53    56     2868  147     2815  153     9930336  153
ppmdi e -o16 -m232       54    58     2865  147     2811  153     9911769  153
ppmn_km e -o6 -M:50     217   218     3150  162     2935  160     9772905  151
ppmn_km e -o7 -M:50     237   239     3187  163     2952  161     9760047  151
ppmn_km e -o8 -M:50     244   246     3183  163     2941  160     9692957  150
ppmn_km e -o9 -M:50     244   246     3184  163     2942  160     9697928  150
ppmn_km e -o9           208   210     3275  168     3068  167    10282808  159
ppmonstr e -o6 -m250    266   289     3123  160     2859  156     9244450  143
ppmonstr e -o9 -m250    272   295     3080  158     2810  153     9046654  140
ppmonstr e -o12 -m250   275   288     3063  157     2789  152     8996048  139
ppmonstr e -o16 -m250   278   300     3072  158     2796  152     8974666  139
ppmonstr e -o32 -m250   287   309     3085  158     2800  152     8958755  138
ppmonstr e -o128 -m250  643   702     3833  197     3196  174     8954077  138
qlfc a                   31    18     3019  155     2988  163    10689214  165
rk -mf1                  33    26     3101  159     3067  167    10946156  169
rk -mf2                  90    70     3025  155     2935  160    10310256  159
rk -mf3                 127    73     2814  144     2688  146     9410064  145
rk -mx1                 498   499     3671  188     3178  173     9627044  149
rk -mx2                 652   655     3924  201     3277  179     9415540  145
rk -mx3                 844   845     4074  209     3238  176     8584928  133
sbc c -m3 -b63           73    21     2191  112     2118  115     7548878  116
sbc c -b63               51    17     2421  124     2370  129     8470431  131
sbc c -ad -b63           59    25     2192  112     2134  116     7587006  117
sbc c -os -b63           51    18     2510  129     2459  134     8785324  136
sbc_d c -os -b63         52    18     2512  129     2459  134     8785324  136
szip -v0                 36    21     3133  161     3097  169    11073758  171
szip -o4                 14    19     3162  162     3148  171    11262438  174
szip -o6                 36    21     3133  161     3097  169    11073758  171
szip -o8                 48    22     3127  160     3078  168    11000643  170
szip -o8 -b41            53    23     3041  156     2988  163    10671420  165
zzip a                   37    22     3054  157     3017  164    10781084  167
zzip a -a                37    20     2946  151     2908  158    10398266  161
zzip a -mx               38    22     2996  154     2957  161    10567860  163
zzip a -mx -mm           39    21     2813  144     2774  151     9907114  153
zzip a -mx -30m          43    22     2976  153     2933  160    10478036  162
abc13 -c                 38    18     2995  154     2960  161    10577286  163
abc24 -c                 58    44     2978  153     2925  159    10351462  160
uharc a -m1 -md32768    103    14     1944  100     1851  101     6577659  101
uharc a -m2 -md32768    127    13     1953  100     1838  100     6522057  101
uharc a -m3 -md32768    142    13     1959  100     1831  100     6490817  100
uharc a -mz -md32768     22    25     2627  135     2607  142     9287969  143
uharc a -mx -md32768    180   155     2129  109     1966  107     6454087  100
ybs -m1m                 35    16     3088  158     3056  166    10931948  169
ybs -m4m                 41    16     3010  154     2972  162    10626638  164
ybs -m16mu               51    17     2654  136     2608  142     9308860  144
ybs -m15mu               49    18     2692  138     2647  144     9448445  146
ybs -m15mu -r            50    17     2686  138     2641  144     9428317  146
ybs_d -m15mu             53    22     2700  138     2652  144     9448445  146

Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600

Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.


[[3]] Details
=============
are no longer put to this main text
(thousands of lines reporting 200,000+ results on 5960 files in 10 sets),
but can be found in FULL version with BINARIES.DAT and *.BAT
at http://compression.ru/artest/artest26.zip
or http://artest1.tripod.com/artest26.zip


[[4]] Comments
==============
Links to download programs
and Homepages
are now in links.htm file

What's new:
~~~~~~~~~~~
12 new programs were tested:

ASH 04a
7-zip 3.13
RAR 3.30b5
UHBC 1.0
EPM 9
Slim 0.021a
BEE 0.7.7
Durilca 0.3a
PAQ 6v2
RKC 1.02
GRZipII 0.2.3
BWIC

As beta versions of RKC, EPM and BWIC fail to compress and/or decompress many
text files, they were not tested on all binary files.

Latest beta versions of DC, Entropy, UHArc were available
from authors by e-mail request:
Entropy: artest@inbox.ru
DC: EdgarBinder@t-online.de
UHArc: Uwe.Herklotz@gmx.de

Results of many other programs are in full version only, BINARIES.DAT file.

FULL version contains all *.BAT and *.DAT files
you'll need to build 10 directories with 5960 files (artest26.zip\COOK_SET\*.*)
and to repeat all tests (BINS.BAT, BINARIES.DAT).


WARNINGS:
~~~~~~~~~
Beta versions of RKC, EPM and BWIC fail to compress and/or decompress many
files. Authors are notified.
ASH 04a can fail to decompress some large files if it lacks memory.

BA 1.00beta5 can't losslessly decompress many files: CUN5IF~1.bin, CUN6IF~1 etc
It types nothing like "CRC fails".

DC 0.99.158b fails to decompress HLPCOPY..bin, but only if you compress
with "-mb5" switch and [<output>] filename like "any.dc5".
Says nothing like "CRC fails".

Problems in all other compressors were not found.

ESP, Rkive and many other programs are not tested any more,
their results and links can be found in previous volumes of ARTest.

The LATEST RELEASE, and all previous volumes can be found
at http://compression.ru/artest/


Send your suggestions, comments to artest@inbox.ru
With best kind regards,
A.Ratushnyak
