KCEC
(Kirr's Chess Engine Comparison)
A tournament of original free chess engines
June 16, 2013
Testing summary:
Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 31 engines!
29 best versions of selected engines played 2627 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list
 RankEngine   RatingAv.
Op.		Perf.
Slope		Av.
Df.		Draw-
ness		GamesLOS
Fru 1 Fruit 2.3 32-bit
Fabien Letouzey, Ryan Benitez (2007)		 UCI
Fra
USA
 Europe
North America		 2888 +23
−23
V
V
V
V
V		V
V
 +0.097
±0.421
o
o
o
o
o		o
o
 89.0%
±9.2%		 823      
100
    
Nau 2 Naum 2.0 64-bit
Aleksandar Naumov (2006)		 UCI
Can
 North America 2793 +21
−21
V
V
 +0.042
±0.278
o
o
o
 109.7%
±10.5%		 961
95
100
  
84.3
111
100
    Naum 2.0 32-bit
Aleksandar Naumov (2006)		       2777 +26
−26
V
V
 +0.111
±0.448
o
o
o
 104.0%
±14.3%		 551
16
100
171
100
76
100
Zap 3 Zappa 1.1 64-bit
Anthony Cozzie (2005)		 UCI
USA
 North America 2717 +19
−19		   −0.061
±0.220
o
o
 105.7%
±7.7%		 1190
60
100
77
56.2
61
100
Slo 4 Slow Chess Blitz WV2.1
Jonathan Kreuzer (2006)		 UCI
USA
 North America 2716 +19
−19		   −0.160
±0.331
o
o
 101.8%
±8.5%		 1136
1
100
125
100
65
100
Cra 5 Crafty 21.5 64-bit PS
Robert Hyatt (2007)		 WB
USA
 North America 2652 +17
−17		   +0.004
±0.262
o
o
 106.5%
±9.8%		 1390
64
100
83
95.1
82
100
Thi 6 Thinker 4.7a
Lance Perkins (2004)		 WB
Can
 North America 2634 +17
−17
V
 +0.065
±0.261
o
o
 119.2%
±8.1%		 1366
18
100
132
100
68
100
Bru 7 Bruja 1.9 64-bit JA No-int-book
Dan Honeycutt (2005)		 WB
USA
 North America 2584 +18
−18		   −0.278
±0.285
o
o
 96.3%
±8.1%		 1181
50
100
88
95.2
70
100
Ara 8 Arasan 10.0 64-bit
Jon Dart (2007)		 ! UCI !
USA
 North America 2564 +17
−17		   −0.083
±0.333
o
o
 108.7%
±10.5%		 1293
20
100
98
98.9
48
100
Kin 9 King of Kings 2.56
Koundinya Veluri (2004)		 WB
Can
 North America 2536 +18
−18		   −0.159
±0.328
o
o
 86.4%
±10.3%		 1214
28
100
82
99.7
62
100
Rom 10 RomiChess P3k 64-bit
Michael Sherwin (2008)		 ! WB !
USA
 North America 2502 +18
−18		   −0.117
±0.413
o
 105.2%
±9.0%		 1088
34
100
82
95.4
54
100
Dia 11 Diablo 0.5.1 JA
Marcus Prewarski (2006)		 UCI
USA
 North America 2482 +16
−16		   +0.162
±0.307
o
o
 114.9%
±10.4%		 1408
20
97.3
57
60.2
23
100
Dji 12 Djinn 0.925x
Tom Likens (2006)		 WB
USA
 North America 2479 +16
−16
V
 +0.103
±0.226
o
o
o
 104.4%
±7.4%		 1549
3
99.8
52
99.6
32
99.9
Bet 13 Betsy 6.51 Nobook
Landon W. Rabern (2003)		 ! WB !
USA
 North America 2450 +15
−15
V
 +0.067
±0.184
o
o
o
 104.2%
±9.6%		 1651
29
99.8
34
57.6
31
99.9
GNU 14 GNU Chess 5.07.9b 64-bit JA
Chua Kong-Sian, Stuart Cracraft, Michel Van den Bergh (2009)		 ! WB !
Sin
USA
Net
 Asia
North America
Europe		 2448 +16
−16
V
 −0.078
±0.218
o
o
 87.9%
±7.4%		 1568
2
65.3
33
57.7
4
98.6
Ama 15 Amateur 2.82
Will Singleton (2005)		 WB
USA
 North America 2446 +15
−15
V
V
 −0.167
±0.173
o
o
o
o
 84.7%
±7.7%		 1783
2
97.8
26
96.9
24
99.4
Sag 16 Sage 3.53
David Dahlem (2008)		 WB
USA
 North America 2424 +19
−19		   −0.361
±0.517
o
 91.9%
±11.8%		 1088
22
99.1
29
66.7
27
100
Hor 17 Horizon 4.4
Ron Murawski, Jim Monaghan (2008)		 ! WB !
USA
 North America 2419 +18
−18		   +0.211
±0.333
o
 98.3%
±9.5%		 1152
5
100
91
100
69
100
EXc 18 EXchess 5.01 beta 64-bit JA
Daniel C. Homan (2006)		 ! WB !
USA
 North America 2355 +14
−14		   −0.156
±0.122
o
o
o
o
 108.2%
±8.1%		 1883
64
100
92
96.1
87
100
    GNU Chess 5.07 64-bit JA
Chua Kong-Sian, Stuart Cracraft (2003)		       2332 +22
−22		   +0.166
±0.173
o
o
o
o
o
 76.7%
±15.4%		 839
23
100
111
95.9
47
100
Dor 19 Dorky 3.48
Matt McKnight (2003)		 ! WB !
USA
 North America 2308 +16
−16		   −0.239
±0.177
o
o
o
o
o
 88.4%
±8.4%		 1671
24
99.9
66
96.1
43
100
Lat 20 Latista (Sinobyl) 1.5
Eric Oldre (2006)		 ! WB !
USA
 North America 2289 +16
−16		   +0.071
±0.151
o
o
o
o
 107.0%
±9.9%		 1595
19
100
171
100
147
100
Par 21 Parrot 070722
Johanes Suhardjo (2007)		 ! WB !
USA
 North America 2161 +17
−17		   +0.035
±0.269
o
o
o
 94.3%
±10.5%		 1344
128
100
190
100
171
100
Ger 22 Gerbil 02 64-bit JA
Bruce Moreland (2008)		 WB
USA
 North America 2118 +18
−18		   +0.078
±0.242
o
o
o
 94.0%
±11.8%		 1280
43
100
226
100
98
100
Etu 23 Etude 0.1.2
Jacob Hales (2007)		 ! UCI !
USA
 North America 2063 +19
−19		   +0.091
±0.287
o
o
 99.3%
±9.6%		 1184
55
100
112
89.2
69
100
SSE 24 SSEChessII 2.05 DC
Samuel Slutzky (2005)		 WB
USA
 North America 2049 +17
−17
V
 −0.034
±0.143
o
o
o
o
 92.9%
±9.9%		 1632
14
97.0
76
74.1
21
100
Fai 25 Faile 1.4.4
Adrien Regimbald (2000)		 WB
Can
 North America 2042 +15
−15
Λ
 −0.126
±0.093
o
o
o
o
o
 106.9%
±10.7%		 1968
7
100
148
100
134
100
Sim 26 Simontacchi 1.81
Mike Maxim (2003)		 ! UCI !
USA
 North America 1915 +20
−20		   −0.501
±0.193
o
o
o
o
o
 52.1%
±11.2%		 1216
127
100
376
100
369
100
Sto 27 Storm 0.6
Sean Empey (2000)		 ! WB !
USA
 North America 1673 +25
−25
Λ
Λ
Λ
Λ
 −0.296
±0.218
o
o
o
o
o		o
 92.7%
±18.0%		 800
242
100
373
59.7
246
100
Zot 28 Zotron 4.4.6
Patrick M. King (2004)		 WB
USA
 North America 1669 +24
−24
Λ
Λ
Λ
Λ
 −0.082
±0.173
o
o
o
o
o		o
 122.2%
±18.8%		 800
4
100
308
100
66
  
Exa 29 Exacto 0.d
Daniel Sparks (2006)		 ! WB !
USA
 North America 1607 +26
−26
Λ
Λ
Λ
Λ
Λ		Λ
 −0.116
±0.236
o
o
o
o
o		o
o
 132.5%
±23.3%		 672
62
    
     

Score matrix

Custom engine selection (best versions only)
#NameElo1
Fru
2
Nau
3
Zap
4
Slo
5
Cra
6
Thi
7
Bru
8
Ara
9
Kin
10
Rom
11
Dia
12
Dji
13
Bet
14
GNU
15
Ama
16
Sag
17
Hor
18
EXc
19
Dor
20
Lat
21
Par
22
Ger
23
Etu
24
SSE
25
Fai
26
Sim
27
Sto
28
Zot
29
Exa
1Fruit 2.3 32-bit2888 64%
20.5/32		67%
19.5/29		76%
20.5/27		                         
2Naum 2.0 64-bit279336%
11.5/32		 66%
21/32		53%
17/32		69%
20/29		                        
3Zappa 1.1 64-bit271733%
9.5/29		34%
11/32		 45%
14.5/32		70%
19.5/28		                        
4Slow Chess Blitz WV2.1271624%
6.5/27		47%
15/32		55%
17.5/32		 50%
13/26		                        
5Crafty 21.5 64-bit PS2652 31%
9/29		30%
8.5/28		50%
13/26		 57%
15.5/27		78%
21/27		50%
14.5/29		                     
6Thinker 4.7a2634    43%
11.5/27		 63%
16.5/26		46%
12/26		52%
11.5/22		                    
7Bruja 1.9 64-bit JA No-int-book2584    22%
6/27		37%
9.5/26		 47%
13.5/29		57%
17/30		75%
24/32		 58%
15/26		                 
8Arasan 10.0 64-bit2564    50%
14.5/29		54%
14/26		53%
15.5/29		 50%
12.5/25		66%
21/32		67%
21.5/32		63%
16.5/26		                 
9King of Kings 2.562536     48%
10.5/22		43%
13/30		50%
12.5/25		 48%
15.5/32		56%
18/32		52%
14.5/28		59%
16.5/28		 60%
15/25		              
10RomiChess P3k 64-bit2502      25%
8/32		34%
11/32		52%
16.5/32		 58%
18.5/32		53%
17/32		  62%
20/32		              
11Diablo 0.5.1 JA2482       33%
10.5/32		44%
14/32		42%
13.5/32		 64%
20.5/32		50%
16/32		52%
16.5/32		47%
15/32		58%
18.5/32		52%
16.5/32		            
12Djinn 0.925x2479      42%
11/26		37%
9.5/26		48%
13.5/28		47%
15/32		36%
11.5/32		 69%
21.5/31		55%
17.5/32		52%
13.5/26		61%
19.5/32		58%
18.5/32		61%
16.5/27		           
13Betsy 6.51 Nobook2450        41%
11.5/28		 50%
16/32		31%
9.5/31		 47%
15/32		56%
14/25		50%
16/32		62%
20/32		68%
20.5/30		80%
22.5/28		72%
21/29		         
14GNU Chess 5.07.9b 64-bit JA2448          48%
15.5/32		45%
14.5/32		53%
17/32		 47%
15/32		55%
17.5/32		53%
17/32		75%
24/32		75%
24/32		66%
21/32		         
15Amateur 2.822446        40%
10/25		38%
12/32		53%
17/32		48%
12.5/26		44%
11/25		53%
17/32		 50%
16/32		42%
13.5/32		70%
21/30		57%
16.5/29		87%
22.5/26		         
16Sage 3.532424          42%
13.5/32		39%
12.5/32		50%
16/32		45%
14.5/32		50%
16/32		 64%
20.5/32		56%
18/32		           
17Horizon 4.42419          48%
15.5/32		42%
13.5/32		38%
12/32		47%
15/32		58%
18.5/32		36%
11.5/32		 47%
15/32		           
18EXchess 5.01 beta 64-bit JA2355           39%
10.5/27		32%
9.5/30		25%
8/32		30%
9/30		44%
14/32		53%
17/32		 50%
14/28		40%
10.5/26		    95%
27.5/29		    
19Dorky 3.482308            20%
5.5/28		25%
8/32		43%
12.5/29		  50%
14/28		 48%
13/27		    89%
24/27		    
20Latista (Sinobyl) 1.52289            28%
8/29		34%
11/32		13%
3.5/26		  60%
15.5/26		52%
14/27		 70%
22.5/32		        
21Parrot 0707222161                   30%
9.5/32		 53%
17/32		61%
19.5/32		42%
13.5/32		62%
20/32		    
22Gerbil 02 64-bit JA2118                    47%
15/32		 55%
17.5/32		47%
15/32		58%
18.5/32		    
23Etude 0.1.22063                    39%
12.5/32		45%
14.5/32		 41%
13/32		55%
17.5/32		    
24SSEChessII 2.05 DC2049                    58%
18.5/32		53%
17/32		59%
19/32		 41%
13/32		70%
22.5/32		   
25Faile 1.4.42042                 5%
1.5/29		11%
3/27		 38%
12/32		42%
13.5/32		45%
14.5/32		59%
19/32		 77%
24.5/32		   
26Simontacchi 1.811915                       30%
9.5/32		23%
7.5/32		 83%
26.5/32		80%
25.5/32		 
27Storm 0.61673                         17%
5.5/32		 50%
16/32		62%
20/32
28Zotron 4.4.61669                         20%
6.5/32		50%
16/32		 66%
21/32
29Exacto 0.d1607                          38%
12/32		34%
11/32		 
Score color legend:
(Only pairs with at least 20 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

LOS matrix

Custom engine selection (best versions only)
Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.
#NameElo1
Fru
2
Nau
3
Zap
4
Slo
5
Cra
6
Thi
7
Bru
8
Ara
9
Kin
10
Rom
11
Dia
12
Dji
13
Bet
14
GNU
15
Ama
16
Sag
17
Hor
18
EXc
19
Dor
20
Lat
21
Par
22
Ger
23
Etu
24
SSE
25
Fai
26
Sim
27
Sto
28
Zot
29
Exa
1Fruit 2.3 32-bit2888 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Naum 2.0 64-bit27930.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Zappa 1.1 64-bit27170.00.0 56.2100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Slow Chess Blitz WV2.127160.00.043.8 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Crafty 21.5 64-bit PS26520.00.00.00.0 95.1100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Thinker 4.7a26340.00.00.00.04.9 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
7Bruja 1.9 64-bit JA No-int-book25840.00.00.00.00.00.0 95.2100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
8Arasan 10.0 64-bit25640.00.00.00.00.00.04.8 98.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
9King of Kings 2.5625360.00.00.00.00.00.00.01.1 99.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
10RomiChess P3k 64-bit25020.00.00.00.00.00.00.00.00.3 95.497.3100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
11Diablo 0.5.1 JA24820.00.00.00.00.00.00.00.00.04.6 60.299.899.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
12Djinn 0.925x24790.00.00.00.00.00.00.00.00.02.739.8 99.699.899.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
13Betsy 6.51 Nobook24500.00.00.00.00.00.00.00.00.00.00.20.4 57.665.398.699.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
14GNU Chess 5.07.9b 64-bit JA24480.00.00.00.00.00.00.00.00.00.00.10.242.4 57.797.899.4100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
15Amateur 2.8224460.00.00.00.00.00.00.00.00.00.00.00.134.742.3 96.999.1100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
16Sage 3.5324240.00.00.00.00.00.00.00.00.00.00.00.01.42.23.1 66.7100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
17Horizon 4.424190.00.00.00.00.00.00.00.00.00.00.00.00.30.60.933.3 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
18EXchess 5.01 beta 64-bit JA23550.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
19Dorky 3.4823080.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 96.1100.0100.0100.0100.0100.0100.0100.0100.0100.0
20Latista (Sinobyl) 1.522890.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.03.9 100.0100.0100.0100.0100.0100.0100.0100.0100.0
21Parrot 07072221610.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0
22Gerbil 02 64-bit JA21180.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0
23Etude 0.1.220630.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 89.297.0100.0100.0100.0100.0
24SSEChessII 2.05 DC20490.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.010.8 74.1100.0100.0100.0100.0
25Faile 1.4.420420.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.03.025.9 100.0100.0100.0100.0
26Simontacchi 1.8119150.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 100.0100.0100.0
27Storm 0.616730.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 59.7100.0
28Zotron 4.4.616690.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.040.3 100.0
29Exacto 0.d16070.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Alter engine selection



Alter output selection

Rating list
      Protocols
      Logos
      Flags
      Continents
     LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score
 Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines

Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013