KCEC
(Kirr's Chess Engine Comparison)
A tournament of original free chess engines
June 16, 2013
Testing summary:
Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 7 engines!
7 best versions of selected engines played 112 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list
 RankEngine   RatingAv.
Op.		Perf.
Slope		Av.
Df.		Draw-
ness		GamesLOS
Tra 1 Trace 1.37a
Ross Boyd (2006)		 WB
Aus
 Oceania 2622 +17
−17		   −0.149
±0.259
o
o
 100.9%
±8.8%		 1345      
100
    
Lam 2 LambChop 10.99
Peter McKenzie (2003)		 UCI
New
 Oceania 2531 +17
−17		   −0.112
±0.265
o
o
 101.6%
±9.3%		 1289
91
100
  
100
232
100
Sci 3 Scidlet 3.61 64-bit JA
Shane Hudson (2004)		 WB
New
 Oceania 2390 +15
−15
V
 +0.026
±0.117
o
o
o
o
 94.9%
±10.4%		 1785
141
100
485
100
394
100
Bod 4 Bodo 0.2b
Joel Veness (2003)		 ! WB !
Aus
 Oceania 2137 +15
−15
Λ
 −0.192
±0.114
o
o
o
o
o
 88.3%
±10.2%		 1908
253
100
449
100
308
100
Sma 5 Small Potato 0.6.1
Alejandro Dubrovsky (2003)		 WB
Aus
 Oceania 2082 +16
−16		   +0.022
±0.143
o
o
o
o
 104.0%
±12.0%		 1696
55
100
584
100
331
100
Kan 6 Kanguruh 1.93
Thomas McBurney (2008)		 WB
Aus
 Oceania 1806 +22
−22		   −0.081
±0.151
o
o
o
o
o
 96.9%
±13.1%		 1024
276
100
356
96.9
301
  
SEE 7 SEE 0.6.9
Tor Lattimore (2004)		 ! WB !
Aus
 Oceania 1781 +21
−21
Λ
 +0.016
±0.127
o
o
o
o
o		o
 115.1%
±12.3%		 1088
25
    
     

Score matrix

Custom engine selection (best versions only)
#NameElo1
Tra
2
Lam
3
Sci
4
Bod
5
Sma
6
Kan
7
SEE
1Trace 1.37a2622 66%
14.5/22		     
2LambChop 10.99253134%
7.5/22		      
3Scidlet 3.61 64-bit JA2390   83%
21.5/26		   
4Bodo 0.2b2137  17%
4.5/26		 67%
21.5/32		  
5Small Potato 0.6.12082   33%
10.5/32		   
6Kanguruh 1.931806      48%
15.5/32
7SEE 0.6.91781     52%
16.5/32		 
Score color legend:
(Only pairs with at least 20 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

LOS matrix

Custom engine selection (best versions only)
Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.
#NameElo1
Tra
2
Lam
3
Sci
4
Bod
5
Sma
6
Kan
7
SEE
1Trace 1.37a2622 100.0100.0100.0100.0100.0100.0
2LambChop 10.9925310.0 100.0100.0100.0100.0100.0
3Scidlet 3.61 64-bit JA23900.00.0 100.0100.0100.0100.0
4Bodo 0.2b21370.00.00.0 100.0100.0100.0
5Small Potato 0.6.120820.00.00.00.0 100.0100.0
6Kanguruh 1.9318060.00.00.00.00.0 96.9
7SEE 0.6.917810.00.00.00.00.03.1 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
      Protocols
      Logos
      Flags
      Continents
     LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013