CCRL 40/4
Downloads and Statistics
June 26, 2009
Testing summary:
Total: 464'187 games
played by 818 programs
7198 CPU days (X2 4600+)

White wins: 178'131 (38.4%)
Black wins: 139'982 (30.2%)
Draws: 146'074 (31.5%)
White score: 54.1%

Rating list

CCRL 40/4 Rating List — All engines (best versions only) (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 26, 2009 with Bayeselo based on 464'187 games
RankNameRatingScoreAverage
Opponent		DrawsGamesLOS
ELO+−
1Rybka 3 64-bit 4CPU3265+12−1181.5%−241.927.9%3614 
100.0%
2Naum 4 64-bit 4CPU3153+12−1272.4%−164.933.3%2690
100.0%
3Thinker 5.4c Inert 64-bit 4CPU3044+13−1355.8%−44.536.0%2180
62.8%
4Zappa Mexico II 64-bit 4CPU3042+11−1155.2%−39.339.3%2806
74.5%
5Hiarcs 12.1 4CPU3037+12−1255.7%−43.634.1%2493
88.3%
6‑7Deep Shredder 11 64-bit 4CPU3028+9−953.4%−25.232.7%4700
45.8%
6‑7Deep Sjeng WC2008 64-bit 4CPU3028+11−1154.7%−33.534.1%2802
90.5%
8Deep Fritz 10.1 4CPU3016+15−1550.7%−6.332.1%1496
80.0%
9Glaurung 2.2 64-bit 4CPU3008+11−1151.8%−14.336.4%2797
89.0%
10‑11Bright 0.4a 4CPU2997+13−1345.4%+30.134.0%2090
50.5%
10‑11Toga II 1.4 beta5c 4CPU2997+12−1246.9%+22.038.5%2394
100.0%
12Loop M1-T 64-bit 4CPU2971+9−947.4%+16.637.7%5303
100.0%
13Onno 0.12.0 64-bit2936+14−1457.1%−50.736.9%1856
93.2%
14Deep Junior 10 4CPU2923+10−1046.2%+26.732.7%3454
100.0%
15Ktulu 9.02871+17−1746.9%+23.432.5%1246
87.0%
16Chessmaster 11 4CPU2855+22−2259.2%−64.232.5%699
90.1%
17Crafty 23.0 64-bit 4CPU2836+15−1630.6%+139.230.7%1660
91.5%
18Spike 1.2 Turin2824+5−542.8%+50.133.6%19664
60.2%
19SmarThink 1.102822+15−1542.7%+53.932.0%1640
53.7%
20Scorpio 2.0 32-bit 4CPU2821+17−1831.0%+139.330.0%1254
66.5%
21Chess Tiger 2007.12816+9−948.0%+15.636.3%5123
85.9%
22Delfi 5.4 2CPU2807+15−1543.7%+49.832.5%1550
88.0%
23Deep Frenzee May07 64-bit 2CPU2794+16−1640.6%+71.628.4%1481
69.7%
24Pharaon 3.5.1 4CPU2784+33−3440.5%+63.631.8%305
80.3%
25Booot 4.15.02768+17−1749.8%+3.332.4%1229
53.9%
26BugChess2 1.6.3 64-bit2766+17−1747.4%+21.130.7%1228
79.9%
27Alaric 7072758+9−943.8%+46.227.7%5035
84.5%
28Colossus 2008b2749+16−1645.3%+34.329.1%1488
94.3%
29E.T. Chess 13.01.082734+11−1146.3%+29.032.3%3087
59.6%
30WildCat 82732+14−1443.6%+50.230.6%1944
60.1%
31Movei 00.8.438 (10 10 10)2730+11−1145.1%+36.630.6%3237
79.2%
32Gandalf 62723+13−1338.6%+87.628.1%2192
68.0%
33‑34Alfil 8.1.1 Optimized2718+13−1343.6%+50.627.9%2187
50.2%
33‑34Pro Deo 1.22718+12−1242.9%+53.827.6%2659
56.1%
35Ruffian 2.1.02717+17−1746.5%+26.029.4%1226
57.6%
36Sloppy 0.2.0 64-bit2715+14−1441.0%+67.031.5%1976
66.8%
37Slow Chess Blitz WV2.12711+8−741.2%+64.929.1%7840
71.7%
38GarboChess 2.10 64-bit2706+15−1540.5%+75.025.7%1647
60.6%
39Lemming 0.34 64-bit2703+16−1644.9%+36.730.1%1370
91.2%
40Chiron 0.8.72688+14−1448.1%+13.527.3%1818
63.0%
41Hamsters 0.7 2CPU2684+20−2039.0%+76.535.7%862
66.9%
42SOS 5.12679+11−1146.8%+23.028.9%3238
66.6%
43The Baron 2.23 64-bit2675+18−1847.2%+18.428.7%1078
52.8%
44Pseudo 0.7c2674+10−1149.8%−1.630.0%3477
83.1%
45Aristarch 4.502667+11−1146.1%+28.827.5%3121
56.6%
46Arasan 11.3 64-bit 4CPU2664+22−2212.5%+339.413.0%1386
58.5%
47Petir 4.392662+12−1247.4%+19.632.5%2416
90.1%
48Jonny 2.83 32-bit2651+12−1247.1%+21.126.7%2460
73.0%
49Hermann 2.4 64-bit 2CPU2644+18−1856.5%−53.023.1%1177
66.3%
50Anaconda 2.0.12639+12−1251.2%−8.230.7%2445
93.1%
51Ufim 8.022628+10−1052.9%−23.327.8%4045
98.0%
52AnMon 5.602612+12−1249.4%+4.727.1%2563
64.6%
53‑54Trace 1.37a2609+12−1249.4%+4.327.3%2730
49.7%
53‑54Yace 0.99.872609+15−1552.1%−15.430.3%1632
51.8%
55‑56Little Goliath Evolution 3.12 (TB On)2608+16−1650.3%−1.729.2%1375
51.2%
55‑56Twisted Logic 0.065e352608+33−3342.0%+61.124.2%331
82.5%
57Pepito 1.59 32-bit2590+17−1750.0%+0.232.1%1120
86.3%
58Cerebro 3.01c2575+20−2043.6%+47.625.5%950
55.8%
59Green Light Chess 3.002573+15−1548.9%+6.931.3%1534
53.1%
60Bruja 1.9 64-bit JA No-int-book2572+16−1649.8%+1.726.8%1311
65.9%
61Tao 5.62568+15−1549.0%+5.226.1%1557
80.5%
62Abrok 5.02559+14−1449.9%−3.128.5%1787
53.2%
63Amyan 1.5972558+12−1247.7%+16.327.4%2822
89.1%
64SpiderChess 0706032548+10−1148.6%+10.731.4%3282
56.8%
65‑66Crimson 1.02545+39−4049.6%−1.420.7%242
49.1%
65‑66Matacz 1.3 HT742545+16−1650.2%−1.528.3%1309
72.8%
67King of Kings 2.562538+17−1750.1%−1.924.7%1248
74.9%
68LambChop 10.992531+14−1349.8%+2.128.1%1966
70.3%
69Quark 2.352526+14−1449.6%+3.424.9%1961
81.6%
70‑71Kiwi 0.6d2517+16−1646.3%+25.225.7%1515
48.5%
70‑71Nejmet 3.072517+12−1248.5%+10.226.9%2564
64.2%
72‑73Dragon 4.62514+12−1246.5%+26.925.7%2574
48.9%
72‑73Snitch 1.6.2 32-bit2514+14−1449.0%+6.725.8%1834
55.1%
74Delphil 1.9c2513+19−1947.9%+16.330.7%960
59.1%
75DanaSah 2.85k2508+34−3455.4%−38.531.8%286
62.8%
76‑77KnightDreamer 3.32501+17−1750.8%−6.628.0%1276
49.9%
76‑77Patzer 3.80 2CPU2501+19−1950.2%−4.225.3%1018
55.0%
78RomiChess P3k 64-bit2499+19−1947.1%+24.525.3%1033
62.9%
79Gaia 3.5 32-bit2495+18−1853.7%−30.319.8%1258
54.6%
80Francesca MAD 0.13 Nobook2494+18−1850.3%−3.024.6%1116
55.5%
81Comet B502492+20−2043.7%+45.725.0%887
52.7%
82Amy 0.8.7b DC2491+17−1751.3%−11.422.7%1280
76.5%
83Gosu 0.162482+17−1751.6%−13.821.7%1365
71.0%
84Muse 0.899b2476+13−1353.3%−27.924.7%2419
69.1%
85‑86Der Bringer 1.92472+12−1252.5%−23.524.5%2661
47.8%
85‑86Djinn 0.925x2472+12−1249.3%+2.524.7%2564
68.0%
87Leila 0.53h2467+17−1756.4%−58.320.2%1373
57.6%
88Homer 2.012464+24−2453.9%−30.520.0%629
52.8%
89Crazy Bishop 00522463+17−1755.7%−51.323.7%1407
78.5%
90Betsy 6.51 Nobook2454+18−1857.0%−60.423.4%1151
52.3%
91Queen 3.092452+36−3648.5%+11.733.3%261
65.1%
92Amateur 2.822445+13−1351.5%−17.820.5%2545
57.6%
93Cheese 1.32442+20−2043.6%+45.224.6%957
69.4%
94Phalanx XXII Reborn JA2436+16−1653.8%−40.520.6%1660
89.1%
95Thor's Hammer 2.28 32-bit2422+16−1656.9%−61.117.8%1580
54.6%
96Arion 1.72420+17−1745.3%+33.326.6%1344
76.8%
97Chezzz 1.0.32411+18−1857.6%−66.519.7%1312
57.8%
98OliThink 5.1.4 64-bit2407+36−3743.6%+46.922.4%272
65.6%
99‑100Averno 0.812399+17−1755.9%−54.223.9%1349
48.9%
99‑100Resp 0.19 64-bit Nobook2399+18−1855.8%−54.222.7%1180
71.4%
101Popochin 3.22391+20−2041.1%+61.326.1%952
83.7%
102KnightX 1.922378+17−1755.7%−50.619.5%1432
55.2%
103Scidlet 3.61 x64 JA2376+18−1752.7%−29.820.5%1307
80.1%
104‑105Asterisk 0.62363+25−2543.3%+48.720.7%617
49.6%
104‑105Eeyore 1.482363+18−1852.7%−26.922.0%1244
53.4%
106GreKo 5.32361+39−3944.3%+36.221.7%254
52.8%
107LittleThought 1.03 64-bit 2CPU2359+20−2039.9%+75.120.7%934
54.9%
108EXchess 5.01 64-bit2358+17−1749.9%−6.323.0%1312
56.1%
109Anechka 0.082356+20−2042.7%+54.121.2%987
51.8%
110Natwarlal 0.142355+19−2040.5%+70.720.9%1017
55.5%
111Horizon 4.32353+23−2348.6%+6.920.5%772
62.0%
112Deuterium 06.07.24.68b2346+31−3319.5%+257.217.0%501
54.4%
113‑114Ant 2006-F2344+37−3737.6%+91.825.8%267
49.3%
113‑114Zeus 1.272344+44−4359.0%−85.320.8%216
54.5%
115Doctor 3.02341+19−1953.4%−32.926.6%1053
56.0%
116Esc 1.162339+20−2054.1%−35.421.2%1022
56.6%
117Sage 2.2a2336+24−2448.5%+6.221.4%674
96.0%
118Latista 1.502302+31−3145.3%+37.024.2%376
51.9%
119‑120Atlas 2.202301+27−2742.8%+47.421.8%536
49.7%
119‑120Dorky 3.482301+20−2050.6%−7.919.3%959
96.1%
121Madeleine 0.22277+19−1944.5%+38.020.0%1085
55.4%
122Chispa 4.0.32275+18−1843.6%+45.235.7%1117
72.3%
123Neurosis 2.32259+45−4721.7%+227.717.4%224
57.7%
124BlackBishop 0.982253+26−2624.7%+203.417.3%684
71.8%
125InmiChess3.06N2243+19−2040.4%+72.919.4%1085
92.6%
126Sunsetter 10.3 64-bit2222+22−2344.0%+46.520.1%798
54.9%
127Lime 662219+30−3125.1%+196.716.7%472
53.8%
128‑129Adam 3.02217+36−3641.6%+59.618.1%320
49.3%
128‑129Fortress 1.622217+20−2140.0%+78.921.4%959
99.6%
130GK 0.90 64-bit2178+22−2238.0%+93.720.9%831
58.0%
131Wing 2.0a2174+37−3739.7%+81.720.9%301
68.4%
132Matheus 2.32163+23−2337.5%+96.020.8%769
84.3%
133Monarch 1.72138+38−3752.2%−10.519.3%270
55.8%
134Matant 5.022134+41−4148.6%+12.214.5%256
76.5%
135Bodo 0.2b Nobook2115+24−2530.4%+159.719.2%736
58.2%
136Bestia 0.902111+23−2330.3%+162.917.8%828
52.8%
137Gibbon 2.01b2110+40−4140.2%+89.619.5%256
64.2%
138Ax 0.82100+23−2326.5%+199.816.8%928
80.4%
139Marvin 1.3.02078+40−4052.2%−16.024.8%226
74.1%
140FireFly 2.1.32059+42−4237.4%+106.018.7%235
64.3%
141Faile 1.4.42050+19−1927.4%+200.818.8%1412
96.7%
142Feuerstein 0.4.4.22006+39−4035.0%+128.014.3%280
53.3%
143BamBam2004+28−2845.3%+45.922.8%499
55.9%
144‑145Eagle 0.7.52000+35−3554.3%−34.716.8%316
51.5%
144‑145Micro-Max 4.82000+35−3643.2%+61.420.3%311
85.1%
146Clueless V1.41974+33−3354.3%−34.115.3%352
93.6%
147Mustang 3.01935+41−4152.4%−14.034.9%209
77.9%
148Soldat 0.25b1912+29−3010.4%+393.911.1%915
78.0%
149Alex 1.781892+36−3731.4%+185.515.3%353
66.5%
150BikJump v1.31881+36−3639.4%+79.322.3%287
79.1%
151Heracles 0.5.91861+33−3354.6%−35.320.7%368
100.0%
152Tscp 1.811783+35−3541.7%+65.820.4%339
73.5%
153Roce 0.03601768+32−3237.5%+89.825.7%381
 

Results matrix

All engines (top 12, best versions only)
#NameELO1
Rybka
2
Naum
3
Think
4
Zappa
5
Hiarc
6
Deep
7
Deep
8
Deep
9
Glaur
10
Brigh
11
Toga
12
Loop
1Rybka 3 64-bit 4CPU3265 61 − 39
+36−14=50
−45		82.5 − 16.5
+70−4=25
+27		 81 − 19
+66−4=30
−6		95 − 15
+84−4=22
+53		88 − 12
+80−4=16
+83		82 − 18
+68−4=28
−15		94.5 − 19.5
+78−3=33
−18		86.5 − 13.5
+78−5=17
+34		86 − 14
+77−5=18
+24		83.5 − 17.5
+69−3=29
−55
2Naum 4 64-bit 4CPU315339 − 61
+14−36=50
+45		 68.5 − 29.5
+48−9=41
+19		61.5 − 38.5
+39−16=45
−38		69.5 − 30.5
+54−15=31
+19		70.5 − 28.5
+52−10=37
+14		70.5 − 29.5
+55−14=31
+16		 9 − 5
+7−3=4
−46		73 − 27
+59−13=28
+7		71 − 29
+53−11=36
−15		76.5 − 21.5
+63−8=27
+20
3Thinker 5.4c Inert 64-bit 4CPU304416.5 − 82.5
+4−70=25
−27		29.5 − 68.5
+9−48=41
−19		 47 − 53
+25−31=44
−19		48.5 − 51.5
+30−33=37
−18		54.5 − 45.5
+34−25=41
+12		54 − 46
+37−29=34
+12		 59 − 41
+44−26=30
+24		56 − 44
+38−26=36
−8		62 − 38
+42−18=40
+30		59.5 − 37.5
+41−19=37
0
4Zappa Mexico II 64-bit 4CPU3042 38.5 − 61.5
+16−39=45
+38		53 − 47
+31−25=44
+19		 59 − 41
+36−18=46
+49		24.5 − 22.5
+14−12=21
−2		57 − 43
+39−25=36
+33		 63.5 − 36.5
+42−15=43
+49		59.5 − 40.5
+41−22=37
+15		25.5 − 24.5
+12−11=27
−38		29.5 − 19.5
+18−8=23
−8
5Hiarcs 12.1 4CPU303719 − 81
+4−66=30
+6		30.5 − 69.5
+15−54=31
−19		51.5 − 48.5
+33−30=37
+18		41 − 59
+18−36=46
−49		 52 − 48
+33−29=38
+4		52.5 − 47.5
+36−31=33
+6		 57 − 56
+33−32=48
−26		63 − 37
+42−16=42
+41		 56 − 37
+36−17=40
0
6Deep Shredder 11 64-bit 4CPU302815 − 95
+4−84=22
−53		28.5 − 70.5
+10−52=37
−14		45.5 − 54.5
+25−34=41
−12		22.5 − 24.5
+12−14=21
+2		48 − 52
+29−33=38
−4		 52 − 48
+38−34=28
+14		24.5 − 24.5
+16−16=17
−12		46.5 − 53.5
+29−36=35
−43		43.5 − 55.5
+25−37=37
−69		27 − 22
+17−12=20
+3		42 − 42
+27−27=30
−61
7Deep Sjeng WC2008 64-bit 4CPU302812 − 88
+4−80=16
−83		29.5 − 70.5
+14−55=31
−16		46 − 54
+29−37=34
−12		43 − 57
+25−39=36
−33		47.5 − 52.5
+31−36=33
−6		48 − 52
+34−38=28
−14		  67.5 − 45.5
+48−26=39
+45		50 − 50
+32−32=36
−29		50 − 50
+26−26=48
−31		58 − 42
+38−22=40
−6
8Deep Fritz 10.1 4CPU301618 − 82
+4−68=28
+15		    24.5 − 24.5
+16−16=17
+12		     31 − 19
+24−12=14
+39
9Glaurung 2.2 64-bit 4CPU300819.5 − 94.5
+3−78=33
+18		5 − 9
+3−7=4
+46		41 − 59
+26−44=30
−24		36.5 − 63.5
+15−42=43
−49		56 − 57
+32−33=48
+26		53.5 − 46.5
+36−29=35
+43		45.5 − 67.5
+26−48=39
−45		  52 − 48
+37−33=30
+2		48 − 52
+27−31=42
−22		59 − 40
+38−19=42
+23
10Bright 0.4a 4CPU299713.5 − 86.5
+5−78=17
−34		27 − 73
+13−59=28
−7		44 − 56
+26−38=36
+8		40.5 − 59.5
+22−41=37
−15		37 − 63
+16−42=42
−41		55.5 − 43.5
+37−25=37
+69		50 − 50
+32−32=36
+29		 48 − 52
+33−37=30
−2		 45.5 − 54.5
+27−36=37
−28		57 − 42
+39−24=36
+23
11Toga II 1.4 beta5c 4CPU299714 − 86
+5−77=18
−24		29 − 71
+11−53=36
+15		38 − 62
+18−42=40
−30		24.5 − 25.5
+11−12=27
+38		 22 − 27
+12−17=20
−3		50 − 50
+26−26=48
+31		 52 − 48
+31−27=42
+22		54.5 − 45.5
+36−27=37
+28		 22.5 − 24.5
+9−11=27
−40
12Loop M1-T 64-bit 4CPU297117.5 − 83.5
+3−69=29
+55		21.5 − 76.5
+8−63=27
−20		37.5 − 59.5
+19−41=37
0		19.5 − 29.5
+8−18=23
+8		37 − 56
+17−36=40
0		42 − 42
+27−27=30
+61		42 − 58
+22−38=40
+6		19 − 31
+12−24=14
−39		40 − 59
+19−38=42
−23		42 − 57
+24−39=36
−23		24.5 − 22.5
+11−9=27
+40		 
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

All engines (top 12, best versions only)
#NameELO1
Ryb
2
Nau
3
Thi
4
Zap
5
Hia
6
Dee
7
Dee
8
Dee
9
Gla
10
Bri
11
Tog
12
Loo
1Rybka 3 64-bit 4CPU3265 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Naum 4 64-bit 4CPU31530.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Thinker 5.4c Inert 64-bit 4CPU30440.00.0 62.882.598.697.399.8100.0100.0100.0100.0
4Zappa Mexico II 64-bit 4CPU30420.00.037.2 74.597.795.799.7100.0100.0100.0100.0
5Hiarcs 12.1 4CPU30370.00.017.525.5 88.384.298.1100.0100.0100.0100.0
6Deep Shredder 11 64-bit 4CPU30280.00.01.42.311.7 45.891.199.8100.0100.0100.0
7Deep Sjeng WC2008 64-bit 4CPU30280.00.02.74.315.854.2 90.599.7100.0100.0100.0
8Deep Fritz 10.1 4CPU30160.00.00.20.31.98.99.5 80.096.497.1100.0
9Glaurung 2.2 64-bit 4CPU30080.00.00.00.00.00.20.320.0 89.090.1100.0
10Bright 0.4a 4CPU29970.00.00.00.00.00.00.03.611.0 50.5100.0
11Toga II 1.4 beta5c 4CPU29970.00.00.00.00.00.00.02.99.949.5 100.0
12Loop M1-T 64-bit 4CPU29710.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Complete list (all engines and versions)

Pure list (removes rating distortions)

Selections from the complete rating list:

All engines   |   32-bit

1-2-CPU engines   |   32-bit

Single-CPU engines   |   32-bit

Multi-CPU engines   |   32-bit

2-CPU engines   |   32-bit

4-CPU engines   |   32-bit

Free engines   |   32-bit

Free 1-2-CPU engines   |   32-bit

Free single-CPU engines   |   32-bit

Free multi-CPU engines   |   32-bit

Free 2-CPU engines   |   32-bit

Free 4-CPU engines   |   32-bit

Open source engines   |   32-bit

Open source 1-2-CPU engines   |   32-bit

Open source single-CPU engines   |   32-bit

Open source multi-CPU engines   |   32-bit

Open source 2-CPU engines   |   32-bit

Open source 4-CPU engines   |   32-bit

Custom comparison

Step 1. Select class of engines to compare:

Only public releases (no private engines)
Only stable versions (no beta versions)
Only engines with default settings
Only new versions
Only best versions from each family

Select additional individual engines or engine families. You can select multiple items in each list by pressing SHIFT or CTRL while selecting. These lists can be used all at the same time, all selections will be simply combined together.

Families

Engines


Step 2. Select output that you want to see.

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Ponder hit table
Eval difference table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in ELO range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Step 3.


Download games in PGN format

All games are compressed with 7-zip.

All games, without comments

464'187 games (87.76 MB)

Selection of games
(Please don't use aggressive download managers)

Various statistics

Created in 2005-2008 by CCRL team
Last games added on June 26, 2009