KCEC
(Kirr's Chess Engine Comparison)
A tournament of original free chess engines
June 16, 2013
Testing summary:
Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 8 engines!
8 best versions of selected engines played 252 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list
 RankEngine   RatingAv.
Op.
Perf.
Slope
Av.
Df.
Draw-
ness
GamesLOS
Sma 1 SmarThink 0.17a
Sergei Markoff (2003)
WB
Rus
Europe 2633 +16
−16
  +0.183
±0.246
o
o
105.7%
±7.4%
1560      
66.3
   
Ufi 2 Ufim 8.02
Niyaz Khasanov (2006)
UCI
Rus
Europe 2628 +18
−18
V
+0.119
±0.326
o
o
106.0%
±10.0%
1273
5
100
 
100
249
100
Eey 3 Eeyore 1.48
Anton Maydell (2004)
WB
Rus
Europe 2384 +15
−15
V
−0.040
±0.124
o
o
o
o
99.5%
±8.9%
1747
244
100
287
100
282
100
Zeu 4 Zeus 1.29
Vadim Bykov (2007)
WB
Rus
Europe 2346 +16
−16
  +0.046
±0.191
o
o
o
106.9%
±10.9%
1504
38
100
308
99.0
64
100
Ane 5 Anechka 0.08
Sergei Nefedov (2006)
UCI
Rus
Europe 2320 +16
−16
  −0.034
±0.202
o
o
o
o
93.2%
±10.1%
1536
26
100
112
100
74
100
Ura 6 Uralochka 1.1b
Ivan Maklyakov (2008)
UCI
Rus
Europe 2272 +18
−18
  +0.068
±0.215
o
o
o
93.2%
±10.6%
1216
48
100
556
100
530
100
Ada 7 Adamant 1.7
George Varentsov (2005)
WB
Rus
Europe 1790 +19
−19
Λ
Λ
Λ
Λ
−0.150
±0.112
o
o
o
o
o
o
o
o
93.5%
±12.6%
1536
482
100
591
100
543
 
ALC 8 ALChess 1.5b
Alex Lobanov (2007)
UCI
Rus
Europe 1729 +22
−22
Λ
Λ
Λ
Λ
−0.057
±0.171
o
o
o
o
o
o
96.3%
±15.7%
1024
61
   
     

Score matrix

Custom engine selection (best versions only)
#NameElo12345678
1SmarThink 0.17a2633 41%
11.5/28
      
2Ufim 8.02262859%
16.5/28
       
3Eeyore 1.482384   58%
18.5/32
73%
23.5/32
69%
22/32
  
4Zeus 1.292346  42%
13.5/32
 50%
16/32
55%
17.5/32
  
5Anechka 0.082320  27%
8.5/32
50%
16/32
 59%
19/32
  
6Uralochka 1.1b2272  31%
10/32
45%
14.5/32
41%
13/32
   
7Adamant 1.71790       59%
19/32
8ALChess 1.5b1729      41%
13/32
 
Score color legend:
(Only pairs with at least 20 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

LOS matrix

Custom engine selection (best versions only)
Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.
#NameElo12345678
1SmarThink 0.17a2633 66.3100.0100.0100.0100.0100.0100.0
2Ufim 8.02262833.7 100.0100.0100.0100.0100.0100.0
3Eeyore 1.4823840.00.0 100.0100.0100.0100.0100.0
4Zeus 1.2923460.00.00.0 99.0100.0100.0100.0
5Anechka 0.0823200.00.00.01.0 100.0100.0100.0
6Uralochka 1.1b22720.00.00.00.00.0 100.0100.0
7Adamant 1.717900.00.00.00.00.00.0 100.0
8ALChess 1.5b17290.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
      Protocols
      Logos
      Flags
      Continents
     LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013