KCEC
(Kirr's Chess Engine Comparison)
A tournament of original free chess engines
June 16, 2013
Testing summary:
Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 17 engines!
16 best versions of selected engines played 710 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list
 RankEngine   RatingAv.
Op.		Perf.
Slope		Av.
Df.		Draw-
ness		GamesLOS
Fru 1 Fruit 2.3 32-bit
Fabien Letouzey, Ryan Benitez (2007)		 UCI
Fra
USA
 Europe
North America		 2888 +23
−23
V
V
V
V
V		V
V
 +0.097
±0.421
o
o
o
o
o		o
o
 89.0%
±9.2%		 823      
100
    
E.T 2 E.T. Chess 13.01.08
Eric Triki (2008)		 WB
Fra
 Europe 2733 +21
−21		   −0.146
±0.274
o
o
 97.4%
±9.9%		 919
155
100
  
98.8
184
100
Pha 3 Pharaon 3.5.1
Franck Zibi (2006)		 UCI
Fra
 Europe 2704 +19
−19		   −0.035
±0.265
o
o
 90.1%
±7.9%		 1295
29
100
227
100
72
100
Bug 4 BugChess2 1.5.2
Francois Karr, Jean-Philippe Karr (2007)		 WB
Fra
 Europe 2661 +18
−18
V
 −0.201
±0.312
o
o
 94.3%
±8.6%		 1278
43
100
112
100
83
100
AnM 5 AnMon 5.60
Christian Barreteau (2005)		 UCI
Fra
 Europe 2621 +18
−18		   +0.020
±0.266
o
o
 96.0%
±10.8%		 1299
40
99.9
84
52.9
41
100
    E.T. Chess 18.11.05
Eric Triki (2005)		       2620 +21
−21		   +0.100
±0.267
o
o
 116.5%
±9.8%		 845
1
100
125
100
85
100
Gai 6 Gaia 3.5 64-bit
Jean Francois Romang, David Rabel (2006)		 UCI
Fra
 Europe 2536 +17
−17		   +0.042
±0.278
o
o
 87.4%
±10.5%		 1344
84
100
97
85.3
96
100
Dra 7 Dragon 4.6
Bruno Lucas (2004)		 UCI
Fra
 Europe 2524 +16
−16		   −0.025
±0.182
o
o
o
 109.4%
±11.2%		 1406
12
91.1
99
61.0
15
100
Nej 8 Nejmet 3.07
Jean-Christophe Gabillard (2003)		 UCI
Fra
 Europe 2521 +16
−16		   −0.055
±0.206
o
o
o
 110.3%
±10.0%		 1549
3
100
76
100
64
100
The 9 The Crazy Bishop 0052
Remi Coulom (2004)		 WB
Fra
 Europe 2460 +15
−15
V
 −0.165
±0.171
o
o
o
 95.0%
±8.9%		 1728
61
100
109
100
106
100
Ari 10 Arion 1.7
Gabriel Guillory (2006)		 UCI
Fra
 Europe 2415 +16
−16		   −0.120
±0.212
o
o
o
 113.6%
±9.7%		 1458
45
100
136
99.7
75
100
Kni 11 KnightX 1.92
Christophe Jolly (2005)		 WB
Fra
 Europe 2385 +15
−15
V
 −0.171
±0.184
o
o
o
o
 86.3%
±8.8%		 1713
30
100
245
100
200
100
WJC 12 WJChess 1.64
Jean-Francois Gazet (2004)		 UCI
Fra
 Europe 2215 +16
−16		   −0.199
±0.138
o
o
o
o
o
 96.1%
±9.7%		 1691
170
100
345
100
315
100
La 13 La Dame Blanche 2.0c
Marc-Philippe Huget (1999)		 ! WB !
Fra
 Europe 2070 +19
−19		   +0.143
±0.362
o
o
 87.3%
±13.6%		 1088
145
100
378
100
208
100
Bib 14 BibiChess 0.5
Lucas Braesch, Romain Burgot (2006)		 ! UCI !
Fra
 Europe 2007 +16
−16		   +0.012
±0.122
o
o
o
o
o
 100.7%
±9.8%		 1824
63
100
222
88.2
77
100
Her 15 Heracles 0.6.16
Franck Tempet (2008)		 UCI
Fra
 Europe 1993 +19
−19
V
 +0.033
±0.189
o
o
o
o
 106.4%
±14.7%		 1216
14
100
163
100
100
  
Ran 16 Ranita 2.4
Jean-Yves Lallemand (2003)		 WB
Fra
 Europe 1907 +20
−20
V
 −0.171
±0.184
o
o
o
o
o
 88.4%
±11.9%		 1120
86
    
     

Score matrix

Custom engine selection (best versions only)
#NameElo1
Fru
2
E.T
3
Pha
4
Bug
5
AnM
6
Gai
7
Dra
8
Nej
9
The
10
Ari
11
Kni
12
WJC
13
La
14
Bib
15
Her
16
Ran
1Fruit 2.3 32-bit2888 85%
19.5/23		76%
19/25		             
2E.T. Chess 13.01.08273315%
3.5/23		 57%
13/23		54%
12.5/23		            
3Pharaon 3.5.1270424%
6/25		43%
10/23		 56%
14/25		            
4BugChess2 1.5.22661 46%
10.5/23		44%
11/25		 62%
16/26		           
5AnMon 5.602621   38%
10/26		 58%
18.5/32		76%
17.5/23		71%
13.5/19		        
6Gaia 3.5 64-bit2536    42%
13.5/32		 55%
17.5/32		44%
14/32		58%
18.5/32		       
7Dragon 4.62524    24%
5.5/23		45%
14.5/32		 52%
13/25		69%
18/26		       
8Nejmet 3.072521    29%
5.5/19		56%
18/32		48%
12/25		 55%
12/22		77%
18.5/24		      
9The Crazy Bishop 00522460     42%
13.5/32		31%
8/26		45%
10/22		 68%
17/25		67%
18/27		     
10Arion 1.72415       23%
5.5/24		32%
8/25		 52%
13.5/26		     
11KnightX 1.922385        33%
9/27		48%
12.5/26		 77%
21.5/28		    
12WJChess 1.642215          23%
6.5/28		  80%
25.5/32		  
13La Dame Blanche 2.0c2070             56%
18/32		56%
18/32		 
14BibiChess 0.52007           20%
6.5/32		44%
14/32		 45%
14.5/32		70%
22.5/32
15Heracles 0.6.161993            44%
14/32		55%
17.5/32		 64%
20.5/32
16Ranita 2.41907             30%
9.5/32		36%
11.5/32		 
Score color legend:
(Only pairs with at least 20 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

LOS matrix

Custom engine selection (best versions only)
Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.
#NameElo1
Fru
2
E.T
3
Pha
4
Bug
5
AnM
6
Gai
7
Dra
8
Nej
9
The
10
Ari
11
Kni
12
WJC
13
La
14
Bib
15
Her
16
Ran
1Fruit 2.3 32-bit2888 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2E.T. Chess 13.01.0827330.0 98.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Pharaon 3.5.127040.01.2 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4BugChess2 1.5.226610.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
5AnMon 5.6026210.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Gaia 3.5 64-bit25360.00.00.00.00.0 85.391.1100.0100.0100.0100.0100.0100.0100.0100.0
7Dragon 4.625240.00.00.00.00.014.7 61.0100.0100.0100.0100.0100.0100.0100.0100.0
8Nejmet 3.0725210.00.00.00.00.08.939.0 100.0100.0100.0100.0100.0100.0100.0100.0
9The Crazy Bishop 005224600.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0
10Arion 1.724150.00.00.00.00.00.00.00.00.0 99.7100.0100.0100.0100.0100.0
11KnightX 1.9223850.00.00.00.00.00.00.00.00.00.3 100.0100.0100.0100.0100.0
12WJChess 1.6422150.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0
13La Dame Blanche 2.0c20700.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0
14BibiChess 0.520070.00.00.00.00.00.00.00.00.00.00.00.00.0 88.2100.0
15Heracles 0.6.1619930.00.00.00.00.00.00.00.00.00.00.00.00.011.8 100.0
16Ranita 2.419070.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
      Protocols
      Logos
      Flags
      Continents
     LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013