KCEC
(Kirr's Chess Engine Comparison)
A tournament of original free chess engines
June 16, 2013
Testing summary:
Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 28 engines!
27 best versions of selected engines played 2456 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list
 RankEngine   RatingAv.
Op.		Perf.
Slope		Av.
Df.		Draw-
ness		GamesLOS
Spi 1 Spike 1.2 Turin
Volker Bohm, Ralf Schafer (2006)		 UCI
Ger
 Europe 2842 +23
−23
V
V
V
V
V
 −0.069
±0.332
o
o
o
o
o
 100.1%
±11.3%		 818      
100
    
Lis 2 List 5.12
Fritz Reul (2004)		 UCI
Ger
 Europe 2699 +18
−18		   +0.231
±0.273
o
o
 122.0%
±10.1%		 1303
143
100
  
56.9
145
100
SOS 3 SOS 5.1
Rudolf Huber (2005)		 UCI
Ger
 Europe 2697 +18
−18		   +0.034
±0.240
o
o
 93.2%
±6.9%		 1378
2
99.3
171
98.9
28
100
Ari 4 Aristarch 4.50
Stefan Zipproth (2004)		 UCI
Ger
 Europe 2671 +18
−18		   +0.164
±0.225
o
o
 95.5%
±7.3%		 1418
26
100
47
95.9
45
100
Jon 5 Jonny 2.83
Johannes Zwanzger (2005)		 WB
Ger
 Europe 2652 +17
−17		   −0.138
±0.344
o
o
 94.6%
±8.4%		 1382
19
99.1
53
74.2
27
100
Ana 6 Anaconda 2.0.1
Frank Schneider, Kai Skibbe (2005)		 CB
Ger
 Europe 2644 +17
−17		   −0.015
±0.204
o
o
 107.6%
±7.8%		 1319
8
99.9
57
99.5
38
100
Lit 7 Little Goliath 3.12 Evolution (TB Off)
Michael Borgstadt (2006)		 UCI
Ger
 Europe 2614 +17
−17		   −0.011
±0.231
o
o
 96.1%
±10.6%		 1303
30
99.9
43
67.0
35
99.9
Yac 8 Yace 0.99.87
Dieter Burssner (2004)		 UCI
Ger
 Europe 2609 +17
−17		   +0.088
±0.205
o
o
 106.8%
±8.5%		 1335
5
70.8
37
55.5
7
100
    Little Goliath 3.12 Evolution (TB On)
Michael Borgstadt (2006)		       2607 +19
−19		   −0.023
±0.270
o
o
 108.3%
±9.9%		 1063
2
100
53
100
48
100
Abr 9 Abrok 5.0
Roman Korba (2003)		 UCI
Ger
 Europe 2561 +17
−17		   −0.098
±0.303
o
o
 109.9%
±11.1%		 1321
46
100
73
98.7
71
100
Qua 10 Quark 2.35
Thomas Mayer (2004)		 WB
Ger
 Europe 2536 +16
−16		   −0.133
±0.199
o
o
o
 97.2%
±8.3%		 1412
25
100
86
91.9
40
100
Sni 11 Snitch 1.6.2 32-bit
Klaus Friedel (2006)		 UCI
Ger
 Europe 2521 +15
−15		   −0.126
±0.181
o
o
o
 100.0%
±10.0%		 1614
15
99.9
61
97.1
36
100
Amy 12 Amy 0.8.7b DC
Thorsten Greiner (2004)		 ! WB !
Ger
 Europe 2500 +17
−17		   −0.246
±0.248
o
o
o
 86.2%
±8.1%		 1415
21
100
58
98.0
43
100
Com 13 Comet B68
Ulrich Turke (2005)		 CB
Ger
 Europe 2478 +14
−14		   +0.133
±0.160
o
o
o
 98.5%
±8.7%		 1953
22
100
61
95.8
40
100
Pat 14 Patzer 3.80
Roland Pfister (2006)		 UCI
Ger
 Europe 2460 +16
−16		   +0.223
±0.327
o
o
 96.8%
±9.3%		 1504
18
98.8
45
66.9
23
99.3
Der 15 Der Bringer 1.9
Gerrit Reubold (2001)		 WB
Ger
 Europe 2455 +15
−15		   −0.030
±0.152
o
o
o
 97.6%
±8.7%		 1733
5
76.4
26
62.1
8
100
Hom 16 Homer 2.01
Daniel Mehrmann (2007)		 UCI
Ger
 Europe 2452 +17
−17		   −0.006
±0.327
o
o
 104.1%
±11.0%		 1376
3
100
58
100
53
100
Res 17 Resp 0.19 64-bit JA Nobook
Peter Rosendahl (2002)		 ! WB !
Ger
 Europe 2402 +16
−16
V
 −0.111
±0.154
o
o
o
o
 90.9%
±9.5%		 1483
50
100
223
100
220
100
Sun 18 Sunsetter C10.3 64-bit JA
Ben Dean-Kawamura, Georg v. Zimmermann (2003)		 ! WB !
Ger
 Europe 2232 +16
−16		   +0.075
±0.131
o
o
o
o
o
 92.7%
±11.1%		 1671
170
100
263
100
213
100
Gho 19 Ghost 0.14
Philipp Classen (2004)		 ! WB !
Ger
 Europe 2189 +17
−17		   +0.017
±0.187
o
o
o
 85.8%
±10.6%		 1440
43
100
300
100
130
100
Del 20 DelphiMax 2.9
Max Bauer (2004)		 ! UCI !
Ger
 Europe 2102 +16
−16
Λ
 −0.113
±0.124
o
o
o
o
o
 75.7%
±9.7%		 1852
87
100
157
99.4
114
100
Ele 21 Elephant 1.06
Harald Luessen (2004)		 ! WB !
Ger
 Europe 2075 +16
−16
Λ
 +0.019
±0.151
o
o
o
o
 82.5%
±11.2%		 1724
27
100
127
86.7
40
100
Gul 22 Gullydeckel 2.16pl1
Martin Borriss (2008)		 WB
Ger
 Europe 2062 +19
−19		   −0.386
±0.295
o
o
 87.3%
±11.1%		 1088
13
100
112
100
85
100
Clu 23 Clueless 1.4
Helmut Fett (2007)		 UCI
Ger
 Europe 1990 +18
−18
V
 −0.146
±0.146
o
o
o
o
 64.9%
±8.9%		 1504
72
100
102
91.4
89
100
Eag 24 Eagle 0.7.5
Frank Scharn (2006)		 ! UCI !
Ger
 Europe 1973 +20
−20
V
 +0.072
±0.181
o
o
o
o
 66.8%
±10.0%		 1216
17
100
225
100
153
100
Gri 25 Grizzly 1.40.1b
Michael Lawatsch (2002)		 ! WB !
Ger
 Europe 1837 +20
−20
Λ
 −0.306
±0.130
o
o
o
o
o		o
 66.4%
±13.3%		 1280
136
100
274
100
257
100
IQ2 26 IQ23 003
Mathias Muller (2006)		 UCI
Ger
 Europe 1716 +23
−23
Λ
Λ
 +0.124
±0.198
o
o
o
o
o
 178.3%
±24.2%		 800
121
100
399
100
263
  
Pir 27 Piranha 0.5
Martin Villwock (2003)		 UCI
Ger
 Europe 1574 +28
−28
Λ
Λ
Λ
Λ
Λ		Λ
Λ
 −0.123
±0.284
o
o
o
o
o		o
o
o
 76.2%
±15.5%		 640
142
    
     

Score matrix

Custom engine selection (best versions only)
#NameElo1
Spi
2
Lis
3
SOS
4
Ari
5
Jon
6
Ana
7
Lit
8
Yac
9
Abr
10
Qua
11
Sni
12
Amy
13
Com
14
Pat
15
Der
16
Hom
17
Res
18
Sun
19
Gho
20
Del
21
Ele
22
Gul
23
Clu
24
Eag
25
Gri
26
IQ2
27
Pir
1Spike 1.2 Turin2842 70%
17.5/25		67%
21.5/32		69%
22/32		                       
2List 5.12269930%
7.5/25		 48%
15.5/32		69%
22/32		55%
17.5/32		52%
13.5/26		                     
3SOS 5.1269733%
10.5/32		52%
16.5/32		 61%
19.5/32		61%
19.5/32		50%
14/28		62%
15.5/25		                    
4Aristarch 4.50267131%
10/32		31%
10/32		39%
12.5/32		 50%
16/32		48%
13/27		56%
15/27		58%
18/31		                   
5Jonny 2.832652 45%
14.5/32		39%
12.5/32		50%
16/32		 54%
14/26		47%
14/30		56%
14.5/26		58%
15/26		                  
6Anaconda 2.0.12644 48%
12.5/26		50%
14/28		52%
14/27		46%
12/26		 59%
16/27		70%
16/23		70%
15.5/22		   68%
17/25		              
7Little Goliath 3.12 Evolution (TB Off)2614  38%
9.5/25		44%
12/27		53%
16/30		41%
11/27		 48%
15/31		60%
14.5/24		60%
15.5/26		54%
13/24		70%
15.5/22		72%
18/25		 60%
15.5/26		            
8Yace 0.99.872609   42%
13/31		44%
11.5/26		30%
7/23		52%
16/31		 56%
14.5/26		67%
16/24		73%
19/26		60%
15/25		62%
16/26		 69%
18/26		            
9Abrok 5.02561    42%
11/26		30%
6.5/22		40%
9.5/24		44%
11.5/26		 30%
8.5/28		59%
13/22		70%
17.5/25		56%
14.5/26		 77%
18.5/24		            
10Quark 2.352536      40%
10.5/26		33%
8/24		70%
19.5/28		 50%
11.5/23		54%
13/24		58%
14/24		64%
20.5/32		62%
17.5/28		 69%
12.5/18		          
11Snitch 1.6.2 32-bit2521      46%
11/24		27%
7/26		41%
9/22		50%
11.5/23		 52%
14.5/28		58%
15/26		61%
19.5/32		58%
14/24		61%
19.5/32		63%
17/27		          
12Amy 0.8.7b DC2500      30%
6.5/22		40%
10/25		30%
7.5/25		46%
11/24		48%
13.5/28		 58%
15/26		73%
23.5/32		65%
17/26		50%
16/32		81%
13/16		          
13Comet B682478     32%
8/25		28%
7/25		38%
10/26		44%
11.5/26		42%
10/24		42%
11/26		42%
11/26		 66%
21/32		48%
13/27		53%
17/32		55%
12/22		          
14Patzer 3.802460         36%
11.5/32		39%
12.5/32		27%
8.5/32		34%
11/32		 44%
14/32		50%
16/32		50%
16/32		          
15Der Bringer 1.92455      40%
10.5/26		31%
8/26		23%
5.5/24		38%
10.5/28		42%
10/24		35%
9/26		52%
14/27		56%
18/32		 39%
12.5/32		50%
9.5/19		          
16Homer 2.012452          39%
12.5/32		50%
16/32		47%
15/32		50%
16/32		61%
19.5/32		 53%
17/32		          
17Resp 0.19 64-bit JA Nobook2402         31%
5.5/18		37%
10/27		19%
3/16		45%
10/22		50%
16/32		50%
9.5/19		47%
15/32		 65%
15/23		 86%
21.5/25		       
18Sunsetter C10.3 64-bit JA2232                35%
8/23		 53%
17/32		56%
14/25		82%
23/28		      
19Ghost 0.142189                 47%
15/32		 59%
19/32		70%
22.5/32		      
20DelphiMax 2.92102                14%
3.5/25		44%
11/25		41%
13/32		 41%
11/27		56%
18/32		66%
21/32		    
21Elephant 1.062075                 18%
5/28		30%
9.5/32		59%
16/27		 55%
17.5/32		64%
20.5/32		72%
23/32		   
22Gullydeckel 2.16pl12062                   44%
14/32		45%
14.5/32		 69%
22/32		    
23Clueless 1.41990                   34%
11/32		36%
11.5/32		31%
10/32		 58%
18.5/32		77%
24.5/32		  
24Eagle 0.7.51973                    28%
9/32		 42%
13.5/32		 72%
23/32		  
25Grizzly 1.40.1b1837                      23%
7.5/32		28%
9/32		 61%
19.5/32		88%
28/32
26IQ23 0031716                        39%
12.5/32		 72%
23/32
27Piranha 0.51574                        12%
4/32		28%
9/32		 
Score color legend:
(Only pairs with at least 20 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

LOS matrix

Custom engine selection (best versions only)
Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.
#NameElo1
Spi
2
Lis
3
SOS
4
Ari
5
Jon
6
Ana
7
Lit
8
Yac
9
Abr
10
Qua
11
Sni
12
Amy
13
Com
14
Pat
15
Der
16
Hom
17
Res
18
Sun
19
Gho
20
Del
21
Ele
22
Gul
23
Clu
24
Eag
25
Gri
26
IQ2
27
Pir
1Spike 1.2 Turin2842 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2List 5.1226990.0 56.999.3100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3SOS 5.126970.043.1 98.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Aristarch 4.5026710.00.71.1 95.999.1100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Jonny 2.8326520.00.00.04.1 74.299.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Anaconda 2.0.126440.00.00.00.925.8 99.599.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
7Little Goliath 3.12 Evolution (TB Off)26140.00.00.00.00.10.5 67.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
8Yace 0.99.8726090.00.00.00.00.00.133.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
9Abrok 5.025610.00.00.00.00.00.00.00.0 98.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
10Quark 2.3525360.00.00.00.00.00.00.00.01.3 91.999.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
11Snitch 1.6.2 32-bit25210.00.00.00.00.00.00.00.00.08.1 97.1100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
12Amy 0.8.7b DC25000.00.00.00.00.00.00.00.00.00.12.9 98.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
13Comet B6824780.00.00.00.00.00.00.00.00.00.00.02.0 95.898.899.3100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
14Patzer 3.8024600.00.00.00.00.00.00.00.00.00.00.00.04.2 66.976.4100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
15Der Bringer 1.924550.00.00.00.00.00.00.00.00.00.00.00.01.233.1 62.1100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
16Homer 2.0124520.00.00.00.00.00.00.00.00.00.00.00.00.723.637.9 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
17Resp 0.19 64-bit JA Nobook24020.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
18Sunsetter C10.3 64-bit JA22320.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0
19Ghost 0.1421890.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0
20DelphiMax 2.921020.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 99.4100.0100.0100.0100.0100.0100.0
21Elephant 1.0620750.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.6 86.7100.0100.0100.0100.0100.0
22Gullydeckel 2.16pl120620.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.013.3 100.0100.0100.0100.0100.0
23Clueless 1.419900.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 91.4100.0100.0100.0
24Eagle 0.7.519730.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.08.6 100.0100.0100.0
25Grizzly 1.40.1b18370.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0
26IQ23 00317160.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0
27Piranha 0.515740.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
      Protocols
      Logos
      Flags
      Continents
     LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013