KCEC
(Kirr's Chess Engine Comparison)
A tournament of original free chess engines
June 16, 2013
Testing summary:
Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 13 engines!
10 best versions of selected engines played 229 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list
 RankEngine   RatingAv.
Op.		Perf.
Slope		Av.
Df.		Draw-
ness		GamesLOS
Mov 1 Movei 00.8.438 (10-10-10)
Uri Blass (2007)		 UCI
Isr
 Asia 2722 +21
−21		   −0.045
±0.271
o
o
 103.3%
±10.5%		 990      
99.9
    
Pet 2 Petir 4.39
Peter Alloysius (2007)		 WB
Ind
 Asia 2682 +18
−18		   +0.004
±0.244
o
o
 115.0%
±7.6%		 1233
40
100
  
84.4
52
100
    Petir 4.999999
Peter Alloysius (2007)		       2670 +19
−19		   −0.281
±0.414
o
o
 112.9%
±10.0%		 1141
12
99.8
79
97.2
39
100
    Movei 00.8.403
Uri Blass (2007)		       2643 +22
−22		   +0.064
±0.586
o
 102.3%
±11.5%		 771
27
99.9
48
76.6
36
100
Ktu 3 Ktulu 4.2
Rahman Paidar (2003)		 UCI
Ira
 Asia 2634 +17
−17		   −0.138
±0.248
o
o
 99.9%
±8.8%		 1344
9
100
102
100
75
100
Twi 4 Twisted Logic 20080404x
Edsel Apostol (2008)		 UCI
Phi
 Asia 2568 +18
−18		   +0.049
±0.305
o
o
 82.0%
±7.2%		 1226
66
100
195
100
186
100
GNU 5 GNU Chess 5.07.9b 64-bit JA
Chua Kong-Sian, Stuart Cracraft, Michel Van den Bergh (2009)		 ! WB !
Sin
USA
Net
 Asia
North America
Europe		 2448 +16
−16
V
 −0.078
±0.218
o
o
 87.9%
±7.4%		 1568
120
100
275
100
209
100
Nat 6 Natwarlal 0.14
Pallav Nawani (2007)		 ! WB !
Ind
 Asia 2359 +17
−17		   +0.105
±0.231
o
o
o
 93.9%
±10.5%		 1408
89
100
236
97.3
116
100
    GNU Chess 5.07 64-bit JA
Chua Kong-Sian, Stuart Cracraft (2003)		       2332 +22
−22		   +0.166
±0.173
o
o
o
o
o
 76.7%
±15.4%		 839
27
100
201
100
112
100
Gen 7 Genesis 2.0
Omid David Tabibi (2003)		 WB
Isr
 Asia 2247 +16
−16		   −0.005
±0.144
o
o
o
o
 99.8%
±12.5%		 1493
85
100
240
100
213
100
Ax 8 Ax 0.8
Pham Hong Nguyen (2002)		 ! WB !
Vie
 Asia 2119 +15
−15
Λ
 −0.209
±0.155
o
o
o
o
o
 83.6%
±10.1%		 1967
128
100
359
100
274
100
Sna 9 SnailChess 4.013
Chan Rasjid (2002)		 ! WB !
Sin
 Asia 1973 +19
−19
V
 +0.115
±0.168
o
o
o
o
 98.9%
±14.1%		 1216
146
100
427
100
299
  
Elf 10 Elf 1.3.0
Erdi Ata Bleda (2005)		 ! WB !
Tur
 Asia 1820 +18
−18
Λ
Λ
Λ
Λ
 −0.198
±0.168
o
o
o
o
o		o
o
o
 86.8%
±12.6%		 1628
153
    
     

Score matrix

Custom engine selection (best versions only)
#NameElo1
Mov
2
Pet
3
Ktu
4
Twi
5
GNU
6
Nat
7
Gen
8
Ax
9
Sna
10
Elf
1Movei 00.8.438 (10-10-10)2722 58%
14.5/25		        
2Petir 4.39268242%
10.5/25		 58%
15/26		       
3Ktulu 4.22634 42%
11/26		 69%
18.5/27		      
4Twisted Logic 20080404x2568  31%
8.5/27		       
5GNU Chess 5.07.9b 64-bit JA2448     67%
21.5/32		    
6Natwarlal 0.142359    33%
10.5/32		 61%
19.5/32		   
7Genesis 2.02247     39%
12.5/32		 77%
20/26		  
8Ax 0.82119      23%
6/26		  95%
27.5/29
9SnailChess 4.0131973         81%
26/32
10Elf 1.3.01820       5%
1.5/29		19%
6/32		 
Score color legend:
(Only pairs with at least 20 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

LOS matrix

Custom engine selection (best versions only)
Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.
#NameElo1
Mov
2
Pet
3
Ktu
4
Twi
5
GNU
6
Nat
7
Gen
8
Ax
9
Sna
10
Elf
1Movei 00.8.438 (10-10-10)2722 99.9100.0100.0100.0100.0100.0100.0100.0100.0
2Petir 4.3926820.1 100.0100.0100.0100.0100.0100.0100.0100.0
3Ktulu 4.226340.00.0 100.0100.0100.0100.0100.0100.0100.0
4Twisted Logic 20080404x25680.00.00.0 100.0100.0100.0100.0100.0100.0
5GNU Chess 5.07.9b 64-bit JA24480.00.00.00.0 100.0100.0100.0100.0100.0
6Natwarlal 0.1423590.00.00.00.00.0 100.0100.0100.0100.0
7Genesis 2.022470.00.00.00.00.00.0 100.0100.0100.0
8Ax 0.821190.00.00.00.00.00.00.0 100.0100.0
9SnailChess 4.01319730.00.00.00.00.00.00.00.0 100.0
10Elf 1.3.018200.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
      Protocols
      Logos
      Flags
      Continents
     LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013