KCEC

(Kirr's Chess Engine Comparison)

A tournament of original free chess engines

June 16, 2013

Testing summary:

Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 26 engines!
25 best versions of selected engines played 1985 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list

Fruit 2.3 32-bit
Fabien Letouzey, Ryan Benitez (2007)

UCI

2888

+23
−23

V
V
V
V
V

V
V

+0.097
±0.421

o
o
o
o
o

o
o

89.0%
±9.2%

823

100

Zappa 1.1 64-bit
Anthony Cozzie (2005)

UCI

2717

+19
−19

−0.061
±0.220

o
o

105.7%
±7.7%

1190

171

100

56.2

172

100

Slow Chess Blitz WV2.1
Jonathan Kreuzer (2006)

UCI

2716

+19
−19

−0.160
±0.331

o
o

101.8%
±8.5%

1136

100

236

100

Crafty 21.5 64-bit PS
Robert Hyatt (2007)

2652

+17
−17

+0.004
±0.262

o
o

106.5%
±9.8%

1390

100

133

100

132

100

Bruja 1.9 64-bit JA No-int-book
Dan Honeycutt (2005)

2584

+18
−18

−0.278
±0.285

o
o

96.3%
±8.1%

1181

100

152

95.2

100

Arasan 10.0 64-bit
Jon Dart (2007)

! UCI !

2564

+17
−17

−0.083
±0.333

o
o

108.7%
±10.5%

1293

100

150

100

RomiChess P3k 64-bit
Michael Sherwin (2008)

! WB !

2502

+18
−18

−0.117
±0.413

105.2%
±9.0%

1088

100

102

95.4

100

Diablo 0.5.1 JA
Marcus Prewarski (2006)

UCI

2482

+16
−16

+0.162
±0.307

o
o

114.9%
±10.4%

1408

97.3

60.2

100

Djinn 0.925x
Tom Likens (2006)

2479

+16
−16

+0.103
±0.226

o
o
o

104.4%
±7.4%

1549

99.8

99.6

99.9

Betsy 6.51 Nobook
Landon W. Rabern (2003)

! WB !

2450

+15
−15

+0.067
±0.184

o
o
o

104.2%
±9.6%

1651

99.8

57.6

99.9

GNU Chess 5.07.9b 64-bit JA
Chua Kong-Sian, Stuart Cracraft, Michel Van den Bergh (2009)

! WB !

2448

+16
−16

−0.078
±0.218

o
o

87.9%
±7.4%

1568

65.3

57.7

98.6

Amateur 2.82
Will Singleton (2005)

2446

+15
−15

V
V

−0.167
±0.173

o
o
o
o

84.7%
±7.7%

1783

97.8

96.9

99.4

Sage 3.53
David Dahlem (2008)

2424

+19
−19

−0.361
±0.517

91.9%
±11.8%

1088

99.1

66.7

100

Horizon 4.4
Ron Murawski, Jim Monaghan (2008)

! WB !

2419

+18
−18

+0.211
±0.333

98.3%
±9.5%

1152

100

EXchess 5.01 beta 64-bit JA
Daniel C. Homan (2006)

! WB !

2355

+14
−14

−0.156
±0.122

o
o
o
o

108.2%
±8.1%

1883

100

96.1

100

GNU Chess 5.07 64-bit JA
Chua Kong-Sian, Stuart Cracraft (2003)

2332

+22
−22

+0.166
±0.173

o
o
o
o
o

76.7%
±15.4%

839

100

111

95.9

100

Dorky 3.48
Matt McKnight (2003)

! WB !

2308

+16
−16

−0.239
±0.177

o
o
o
o
o

88.4%
±8.4%

1671

99.9

96.1

100

Latista (Sinobyl) 1.5
Eric Oldre (2006)

! WB !

2289

+16
−16

+0.071
±0.151

o
o
o
o

107.0%
±9.9%

1595

100

171

100

147

100

Parrot 070722
Johanes Suhardjo (2007)

! WB !

2161

+17
−17

+0.035
±0.269

o
o
o

94.3%
±10.5%

1344

128

100

190

100

171

100

Gerbil 02 64-bit JA
Bruce Moreland (2008)

2118

+18
−18

+0.078
±0.242

o
o
o

94.0%
±11.8%

1280

100

226

100

Etude 0.1.2
Jacob Hales (2007)

! UCI !

2063

+19
−19

+0.091
±0.287

o
o

99.3%
±9.6%

1184

100

112

89.2

100

SSEChessII 2.05 DC
Samuel Slutzky (2005)

2049

+17
−17

−0.034
±0.143

o
o
o
o

92.9%
±9.9%

1632

100

203

100

148

100

Simontacchi 1.81
Mike Maxim (2003)

! UCI !

1915

+20
−20

−0.501
±0.193

o
o
o
o
o

52.1%
±11.2%

1216

134

100

390

100

376

100

Storm 0.6
Sean Empey (2000)

! WB !

1673

+25
−25

Λ
Λ
Λ
Λ

−0.296
±0.218

o
o
o
o
o

92.7%
±18.0%

800

242

100

380

59.7

246

100

Zotron 4.4.6
Patrick M. King (2004)

1669

+24
−24

Λ
Λ
Λ
Λ

−0.082
±0.173

o
o
o
o
o

122.2%
±18.8%

800

100

308

100

Exacto 0.d
Daniel Sparks (2006)

! WB !

1607

+26
−26

Λ
Λ
Λ
Λ
Λ

−0.116
±0.236

o
o
o
o
o

o
o

132.5%
±23.3%

672

Score matrix

Custom engine selection (best versions only)

Fruit 2.3 32-bit

2888

67%
19.5/29

76%
20.5/27

Zappa 1.1 64-bit

2717

33%
9.5/29

45%
14.5/32

70%
19.5/28

Slow Chess Blitz WV2.1

2716

24%
6.5/27

55%
17.5/32

50%
13/26

Crafty 21.5 64-bit PS

2652

30%
8.5/28

50%
13/26

78%
21/27

50%
14.5/29

Bruja 1.9 64-bit JA No-int-book

2584

22%
6/27

47%
13.5/29

75%
24/32

58%
15/26

Arasan 10.0 64-bit

2564

50%
14.5/29

53%
15.5/29

66%
21/32

67%
21.5/32

63%
16.5/26

RomiChess P3k 64-bit

2502

25%
8/32

34%
11/32

58%
18.5/32

53%
17/32

62%
20/32

Diablo 0.5.1 JA

2482

33%
10.5/32

42%
13.5/32

64%
20.5/32

50%
16/32

52%
16.5/32

47%
15/32

58%
18.5/32

52%
16.5/32

Djinn 0.925x

2479

42%
11/26

37%
9.5/26

47%
15/32

36%
11.5/32

69%
21.5/31

55%
17.5/32

52%
13.5/26

61%
19.5/32

58%
18.5/32

61%
16.5/27

Betsy 6.51 Nobook

2450

50%
16/32

31%
9.5/31

47%
15/32

56%
14/25

50%
16/32

62%
20/32

68%
20.5/30

80%
22.5/28

72%
21/29

GNU Chess 5.07.9b 64-bit JA

2448

48%
15.5/32

45%
14.5/32

53%
17/32

47%
15/32

55%
17.5/32

53%
17/32

75%
24/32

66%
21/32

Amateur 2.82

2446

38%
12/32

53%
17/32

48%
12.5/26

44%
11/25

53%
17/32

50%
16/32

42%
13.5/32

70%
21/30

57%
16.5/29

87%
22.5/26

Sage 3.53

2424

42%
13.5/32

39%
12.5/32

50%
16/32

45%
14.5/32

50%
16/32

64%
20.5/32

56%
18/32

Horizon 4.4

2419

48%
15.5/32

42%
13.5/32

38%
12/32

47%
15/32

58%
18.5/32

36%
11.5/32

47%
15/32

EXchess 5.01 beta 64-bit JA

2355

39%
10.5/27

32%
9.5/30

25%
8/32

30%
9/30

44%
14/32

53%
17/32

50%
14/28

40%
10.5/26

Dorky 3.48

2308

20%
5.5/28

25%
8/32

43%
12.5/29

50%
14/28

48%
13/27

Latista (Sinobyl) 1.5

2289

28%
8/29

34%
11/32

13%
3.5/26

60%
15.5/26

52%
14/27

70%
22.5/32

Parrot 070722

2161

30%
9.5/32

53%
17/32

61%
19.5/32

42%
13.5/32

Gerbil 02 64-bit JA

2118

47%
15/32

55%
17.5/32

47%
15/32

Etude 0.1.2

2063

39%
12.5/32

45%
14.5/32

41%
13/32

SSEChessII 2.05 DC

2049

58%
18.5/32

53%
17/32

59%
19/32

70%
22.5/32

Simontacchi 1.81

1915

30%
9.5/32

83%
26.5/32

80%
25.5/32

Storm 0.6

1673

17%
5.5/32

50%
16/32

62%
20/32

Zotron 4.4.6

1669

20%
6.5/32

50%
16/32

66%
21/32

Exacto 0.d

1607

38%
12/32

34%
11/32

Score color legend:
(Only pairs with at least 20 games)

10%

15%

20%

25%

30%

35%

40%

45%

50%

55%

60%

65%

70%

75%

80%

85%

90%

95%

100%

LOS matrix

Custom engine selection (best versions only)

Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.

#	Name	Elo	1 Fru	2 Zap	3 Slo	4 Cra	5 Bru	6 Ara	7 Rom	8 Dia	9 Dji	10 Bet	11 GNU	12 Ama	13 Sag	14 Hor	15 EXc	16 Dor	17 Lat	18 Par	19 Ger	20 Etu	21 SSE	22 Sim	23 Sto	24 Zot	25 Exa
1	Fruit 2.3 32-bit	2888		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
2	Zappa 1.1 64-bit	2717	0.0		56.2	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
3	Slow Chess Blitz WV2.1	2716	0.0	43.8		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
4	Crafty 21.5 64-bit PS	2652	0.0	0.0	0.0		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
5	Bruja 1.9 64-bit JA No-int-book	2584	0.0	0.0	0.0	0.0		95.2	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
6	Arasan 10.0 64-bit	2564	0.0	0.0	0.0	0.0	4.8		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
7	RomiChess P3k 64-bit	2502	0.0	0.0	0.0	0.0	0.0	0.0		95.4	97.3	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
8	Diablo 0.5.1 JA	2482	0.0	0.0	0.0	0.0	0.0	0.0	4.6		60.2	99.8	99.9	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
9	Djinn 0.925x	2479	0.0	0.0	0.0	0.0	0.0	0.0	2.7	39.8		99.6	99.8	99.9	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
10	Betsy 6.51 Nobook	2450	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.2	0.4		57.6	65.3	98.6	99.7	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
11	GNU Chess 5.07.9b 64-bit JA	2448	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.1	0.2	42.4		57.7	97.8	99.4	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
12	Amateur 2.82	2446	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.1	34.7	42.3		96.9	99.1	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
13	Sage 3.53	2424	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	1.4	2.2	3.1		66.7	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
14	Horizon 4.4	2419	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.3	0.6	0.9	33.3		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
15	EXchess 5.01 beta 64-bit JA	2355	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
16	Dorky 3.48	2308	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		96.1	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
17	Latista (Sinobyl) 1.5	2289	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	3.9		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
18	Parrot 070722	2161	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		100.0	100.0	100.0	100.0	100.0	100.0	100.0
19	Gerbil 02 64-bit JA	2118	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		100.0	100.0	100.0	100.0	100.0	100.0
20	Etude 0.1.2	2063	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		89.2	100.0	100.0	100.0	100.0
21	SSEChessII 2.05 DC	2049	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	10.8		100.0	100.0	100.0	100.0
22	Simontacchi 1.81	1915	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		100.0	100.0	100.0
23	Storm 0.6	1673	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		59.7	100.0
24	Zotron 4.4.6	1669	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	40.3		100.0
25	Exacto 0.d	1607	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0

LOS color legend:

100

Alter engine selection

Alter output selection

Rating list
Protocols
Logos
Flags
Continents
LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score

Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
No recalibration (reference and current list are compared as they are)
Recalibrate reference list to current one using selected engines only
Recalibrate reference list to current one using all common engines
Recalibrate current list to reference using selected engines only
Recalibrate current list to reference using all common engines

Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013

AICE 0.99.2
ALChess 1.5b
ANT 2006-F
Abrok 5.0
Adamant 1.7
Alaric 704
Alaric 707
Alarm 0.93.1
Aldebaran 0.7.0
Alf 1.09 JA
Alfil 8.1.1 Optimized
Amateur 2.82
Amy 0.8.7b DC
Amyan 1.597
AnMon 5.60
Anaconda 2.0.1
Anechka 0.08
Arasan 10.0 64-bit
Arion 1.7
Aristarch 4.50
Armageddon 2.308
Asterisk 0.6
Atlas 2.20
Averno 0.81
Ax 0.8
Ayito 0.2.994
Belzebub 0.67
Bestia 0.90
Betsy 6.51 Nobook
BibiChess 0.5
BigLion 2.23x
Bodo 0.2b
Booot 4.13.1
Bright 0.2c
Bruja 1.9 64-bit JA No-int-book
BugChess2 1.5.2
Cecir 3.5
Celes 0.77c
Cerebro 3.03d
ChessterfieldCL i5a JA
Chezzz 1.0.3
Chispa 4.0.3
Cilian 4.14
Clarabit 1.00 64-bit
Clueless 1.4
Colossus 2007c
Colossus 2007d
Comet B68
Crafty 21.5 64-bit PS
CyberPagno 2.1 32MB
Delfi 5.2
Delfi 5.4
DelphiMax 2.9
Der Bringer 1.9
Diablo 0.5.1 JA
Djinn 0.925x
Dorky 3.48
Dragon 4.6
E.T. Chess 13.01.08
E.T. Chess 18.11.05
EXchess 5.01 beta 64-bit JA
Eagle 0.7.5
Eeyore 1.48
Elephant 1.06
Elf 1.3.0
Enigma 1.1.4
Esc 1.16
Etude 0.1.2
Exacto 0.d
Faile 1.4.4
Fortress 1.62
Francesca MAD 0.13 Nobook
Frenzee 3.0 64-bit
Frenzee Feb08 64-bit
Fritz 5.32
Fritz 6 Light
Fruit 2.3 32-bit
GNU Chess 5.07 64-bit JA
GNU Chess 5.07.9b 64-bit JA
Gaia 3.5 64-bit
Genesis 2.0
Gerbil 02 64-bit JA
Ghost 0.14
Gk 0.90 64-bit JA
Glaurung 1.2.1 64-bit
Glaurung 2.0.1 64-bit
Gosu 0.16
Green Light Chess 3.00
Grizzly 1.40.1b
Gullydeckel 2.16pl1
Hamsters 0.5
Hamsters 0.6
Heracles 0.6.16
Homer 2.01
Horizon 4.4
IACH 0.56z
IQ23 003
InmiChess 3.06N
JanWillem 1.13
Jonny 2.83
Kanguruh 1.93
King of Kings 2.56
KnightDreamer 3.3
KnightX 1.92
Ktulu 4.2
La Dame Blanche 2.0c
LambChop 10.99
Latista (Sinobyl) 1.5
Laurifer 1.0
Leila 0.53h
Lime 66
List 5.12
Little Goliath 3.12 Evolution (TB Off)
Little Goliath 3.12 Evolution (TB On)
Madeleine 0.2
Marvin 1.3.0
Matacz 1.3 HT74 5-men-egbb
Matant 5.04
Matheus 2.3
Matilde 2008 64-bit
Micro-Max 4.8 PIV DM
MiniMardi 1.3
Mizar 3.0
Monarch 1.7
Morphy 3.22
Movei 00.8.403
Movei 00.8.438 (10-10-10)
Muse 0.899b
Mustang 4.97
NagaSkaki 5.12
Natwarlal 0.14
Naum 2.0 32-bit
Naum 2.0 64-bit
Needle 0.53.1
Nejmet 3.07
Nesik 0.7.0 alpha
Parrot 070722
Patzer 3.80
Pepito 1.59 32-bit
Petir 4.39
Petir 4.999999
Phalanx XXII Reborn JA
Pharaon 3.5.1
Piranha 0.5
Popochin 3.2
PostModernist 1016
Pro Deo 1.6
Pseudo 0.7c
Quark 2.35
Queen 4.03
RDChess 3.23
Rainman 0.7.5
Ranita 2.4
Requiem 0.53
Resp 0.19 64-bit JA Nobook
Rival UCI 1.18
Robin 0.983
RomiChess P3k 64-bit
Ruffian 1.0.5
SEE 0.6.9
SOS 5.1
SSEChessII 2.05 DC
Sage 3.53
Scidlet 3.61 64-bit JA
Scorpio 1.91
Scorpio 2.0 32-bit
Sharper 0.17
Simontacchi 1.81
Sjeng 12.13
Slow Chess Blitz WV2.1
Small Potato 0.6.1
SmarThink 0.17a
Smash 1.0.3
SnailChess 4.013
Snitch 1.6.2 32-bit
Soldat 0.25b
Sorgenkind 0.4
SpiderChess 070603
Spike 1.2 Turin
Storm 0.6
Sunsetter C10.3 64-bit JA
Tao 5.6
The Baron 1.8.1
The Baron 2.23 64-bit
The Crazy Bishop 0052
Thinker 4.7a
Thor's Hammer 2.28 32-bit
Trace 1.37a
Twisted Logic 20080404x
Tytan 9.32 64-bit
Ufim 8.02
Uragano 3D 0.87
Uralochka 1.1b
WJChess 1.64
Warrior 1.0.3
WildCat 7
WildCat 8
Wing 2.0a
Yace 0.99.87
Zappa 1.1 64-bit
Zeus 1.29
Zotron 4.4.6