KCEC
(Kirr's Chess Engine Comparison)
A tournament of original free chess engines
June 16, 2013
Testing summary:
Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 8 engines!
7 best versions of selected engines played 115 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list
 RankEngine   RatingAv.
Op.		Perf.
Slope		Av.
Df.		Draw-
ness		GamesLOS
Col 1 Colossus 2007d
Martin Bryant (2007)		 UCI
Uni
 Europe 2707 +20
−20		   −0.099
±0.286
o
o
 101.1%
±8.3%		 1036      
85.3
    
    Colossus 2007c
Martin Bryant (2007)		       2694 +19
−19		   +0.004
±0.263
o
o
 107.2%
±9.9%		 1144
13
100
  
100
125
100
Gre 2 Green Light Chess 3.00
Tim Foden (2003)		 WB
Uni
 Europe 2582 +17
−17		   −0.034
±0.222
o
o
 114.2%
±7.9%		 1327
112
100
214
100
201
100
Fra 3 Francesca MAD 0.13 Nobook
Tom King (2006)		 ! WB !
Uni
 Europe 2493 +19
−19		   −0.251
±0.371
o
o
 93.3%
±13.1%		 1072
89
100
214
86.4
102
100
Pos 4 PostModernist 1016
Andrew Williams (2006)		 WB
Uni
 Europe 2480 +16
−16		   −0.032
±0.265
o
o
 94.9%
±9.0%		 1536
13
100
341
100
252
100
Lim 5 Lime 66
Richard Allbert (2008)		 ! UCI !
Uni
 Europe 2241 +18
−18		   +0.038
±0.185
o
o
o
 86.0%
±10.7%		 1248
239
100
362
100
349
100
Mon 6 Monarch 1.7
Steve Maughan (2006)		 ! UCI !
Uni
 Europe 2131 +16
−16		   +0.066
±0.165
o
o
o
o
 94.8%
±12.1%		 1664
110
100
459
100
220
  
Riv 7 Rival UCI 1.18
Chris Moreton (2007)		 UCI
Uni
 Europe 2021 +17
−17		   −0.079
±0.154
o
o
o
o
 89.2%
±10.2%		 1536
110
    
     

Score matrix

Custom engine selection (best versions only)
#NameElo1
Col
2
Gre
3
Fra
4
Pos
5
Lim
6
Mon
7
Riv
1Colossus 2007d2707       
2Green Light Chess 3.002582  47%
9/19		    
3Francesca MAD 0.13 Nobook2493 53%
10/19		 48%
15.5/32		   
4PostModernist 10162480  52%
16.5/32		    
5Lime 662241     67%
21.5/32		 
6Monarch 1.72131    33%
10.5/32		 72%
23/32
7Rival UCI 1.182021     28%
9/32		 
Score color legend:
(Only pairs with at least 20 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

LOS matrix

Custom engine selection (best versions only)
Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.
#NameElo1
Col
2
Gre
3
Fra
4
Pos
5
Lim
6
Mon
7
Riv
1Colossus 2007d2707 100.0100.0100.0100.0100.0100.0
2Green Light Chess 3.0025820.0 100.0100.0100.0100.0100.0
3Francesca MAD 0.13 Nobook24930.00.0 86.4100.0100.0100.0
4PostModernist 101624800.00.013.6 100.0100.0100.0
5Lime 6622410.00.00.00.0 100.0100.0
6Monarch 1.721310.00.00.00.00.0 100.0
7Rival UCI 1.1820210.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
      Protocols
      Logos
      Flags
      Continents
     LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013