KCEC

(Kirr's Chess Engine Comparison)

A tournament of original free chess engines

June 16, 2013

Testing summary:

Total: 135,679 games
played by 202 programs
1398 CPU days (X2 4600+)

White wins: 55,227 (40.7%)
Black wins: 47,434 (35.0%)
Draws: 33,018 (24.3%)
White score: 52.9%

Custom engine selection

Comparing 17 engines!
15 best versions of selected engines played 598 games with each other

KCEC Rating List — Custom engine selection (Quote)

Ponder off, neutral book (up to 8 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on June 16, 2013 with Bayeselo based on 135,679 games
Note: Please see how to read the list

Bright 0.2c
Allard Siemelink (2007)

UCI

2786

+23
−23

V
V

−0.280
±0.390

o
o
o

98.2%
±10.3%

739

100

Pro Deo 1.6
Ed Schroder (2007)

2719

+22
−22

+0.009
±0.324

o
o

94.0%
±9.6%

903

100

117

100

The Baron 2.23 64-bit
Richard Pijl (2008)

2669

+19
−19

−0.206
±0.281

o
o

85.6%
±7.9%

1248

100

135

93.7

100

The Baron 1.8.1
Richard Pijl (2006)

2651

+18
−18

+0.201
±0.324

o
o

84.4%
±8.2%

1308

98.8

75.4

100

Fritz 5.32
Frans Morsch (2001)

2643

+17
−17

+0.191
±0.268

o
o

114.4%
±10.7%

1352

97.7

91.7

100

Fritz 6 Light
Frans Morsch (2006)

2627

+19
−19

−0.143
±0.296

o
o

103.5%
±12.2%

1066

100

Tao 5.6
Bas Hamstra (2004)

! UCI !

2574

+17
−17

−0.327
±0.271

o
o

95.5%
±9.7%

1370

100

99.2

100

SpiderChess 070603
Martin Giepmans (2007)

2546

+17
−17

+0.364
±0.256

o
o

132.1%
±12.0%

1311

100

161

100

108

100

Queen 4.03
Leen Ammeraal (2007)

UCI

2466

+17
−17

+0.011
±0.350

121.8%
±9.1%

1216

100

126

94.0

100

GNU Chess 5.07.9b 64-bit JA
Chua Kong-Sian, Stuart Cracraft, Michel Van den Bergh (2009)

! WB !

2448

+16
−16

−0.078
±0.218

o
o

87.9%
±7.4%

1568

100

213

100

133

100

ANT 2006-F
Tom Vijlbrief (2006)

2333

+16
−16

+0.077
±0.164

o
o
o
o

90.7%
±8.5%

1562

115

100

272

100

254

100

Gk 0.90 64-bit JA
Tijs van Dam (2003)

2194

+16
−16

−0.128
±0.153

o
o
o
o
o

94.4%
±9.8%

1688

139

100

269

92.0

154

100

Wing 2.0a
Stef Luijten (2005)

2179

+16
−16

−0.130
±0.145

o
o
o
o
o

99.7%
±12.0%

1680

100

271

100

132

100

JanWillem 1.13
Laurens Winkelhagen (2004)

2062

+16
−16

−0.130
±0.139

o
o
o
o
o

89.9%
±9.3%

1809

117

100

166

99.9

151

100

Micro-Max 4.8 PIV DM
Harm Geert Muller (2008)

! WB !

2028

+17
−17

+0.037
±0.135

o
o
o
o

118.4%
±14.0%

1600

100

205

100

Morphy 3.22
Eric Walstra (2000)

! WB !

1974

+17
−17

+0.037
±0.140

o
o
o
o
o

114.8%
±14.7%

1472

100

141

100

107

Celes 0.77c
Johan Hutting (2003)

! UCI !

1921

+20
−20

+0.048
±0.161

o
o
o
o
o

94.4%
±12.0%

1184

Score matrix

Custom engine selection (best versions only)

Bright 0.2c

2786

54%
14.5/27

72%
23/32

Pro Deo 1.6

2719

46%
12.5/27

66%
21/32

The Baron 2.23 64-bit

2669

28%
9/32

34%
11/32

61%
19.5/32

Fritz 5.32

2643

39%
12.5/32

50%
13.5/27

37%
8.5/23

Tao 5.6

2574

50%
13.5/27

52%
14/27

SpiderChess 070603

2546

63%
14.5/23

48%
13/27

Queen 4.03

2466

41%
13/32

GNU Chess 5.07.9b 64-bit JA

2448

59%
19/32

ANT 2006-F

2333

41%
13/32

59%
16/27

66%
19/29

Gk 0.90 64-bit JA

2194

41%
11/27

68%
19/28

66%
18.5/28

Wing 2.0a

2179

34%
10/29

32%
9/28

80%
24/30

73%
23.5/32

JanWillem 1.13

2062

34%
9.5/28

20%
6/30

59%
19/32

69%
22/32

Micro-Max 4.8 PIV DM

2028

27%
8.5/32

41%
13/32

53%
17/32

69%
22/32

Morphy 3.22

1974

31%
10/32

47%
15/32

56%
18/32

Celes 0.77c

1921

31%
10/32

44%
14/32

Score color legend:
(Only pairs with at least 20 games)

10%

15%

20%

25%

30%

35%

40%

45%

50%

55%

60%

65%

70%

75%

80%

85%

90%

95%

100%

LOS matrix

Custom engine selection (best versions only)

Each cell shows likelihood of superiority of one engine over the other one, in percents. These numbers are computed using Bayeselo for the complete game database.

#	Name	Elo	1 Bri	2 Pro	3 The	4 Fri	5 Tao	6 Spi	7 Que	8 GNU	9 ANT	10 Gk	11 Win	12 Jan	13 Mic	14 Mor	15 Cel
1	Bright 0.2c	2786		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
2	Pro Deo 1.6	2719	0.0		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
3	The Baron 2.23 64-bit	2669	0.0	0.0		98.8	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
4	Fritz 5.32	2643	0.0	0.0	1.2		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
5	Tao 5.6	2574	0.0	0.0	0.0	0.0		99.2	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
6	SpiderChess 070603	2546	0.0	0.0	0.0	0.0	0.8		100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
7	Queen 4.03	2466	0.0	0.0	0.0	0.0	0.0	0.0		94.0	100.0	100.0	100.0	100.0	100.0	100.0	100.0
8	GNU Chess 5.07.9b 64-bit JA	2448	0.0	0.0	0.0	0.0	0.0	0.0	6.0		100.0	100.0	100.0	100.0	100.0	100.0	100.0
9	ANT 2006-F	2333	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		100.0	100.0	100.0	100.0	100.0	100.0
10	Gk 0.90 64-bit JA	2194	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		92.0	100.0	100.0	100.0	100.0
11	Wing 2.0a	2179	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	8.0		100.0	100.0	100.0	100.0
12	JanWillem 1.13	2062	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		99.9	100.0	100.0
13	Micro-Max 4.8 PIV DM	2028	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.1		100.0	100.0
14	Morphy 3.22	1974	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0		100.0
15	Celes 0.77c	1921	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0	0.0

LOS color legend:

100

Alter engine selection

Alter output selection

Rating list
Protocols
Logos
Flags
Continents
LOS columns:

Crosstables:
Results
Performances
Score
LOS
Ponder hit
Eval difference
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Expected score

Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents
Ponder hit with common opponents
Ponder hit with all opponents
Eval difference with common opponents
Eval difference with all opponents

Ponder hit: most similar pairs
Ponder hit: most similar pairs (different families only)
Ponder hit: most different pairs
Ponder hit: most different pairs (same families only)
Eval diff: most similar pairs
Eval diff: most similar pairs (different families only)
Eval diff: most different pairs
Eval diff: most different pairs (same families only)

Maximum size of cross-tables (from 2 to 200):
Limit crosstables to engines in Elo range: to

Cross-tables show only best version of each engine
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
No recalibration (reference and current list are compared as they are)
Recalibrate reference list to current one using selected engines only
Recalibrate reference list to current one using all common engines
Recalibrate current list to reference using selected engines only
Recalibrate current list to reference using all common engines

Created in 2005-2012 by Kirill Kryukov
Updated on June 16, 2013

AICE 0.99.2
ALChess 1.5b
ANT 2006-F
Abrok 5.0
Adamant 1.7
Alaric 704
Alaric 707
Alarm 0.93.1
Aldebaran 0.7.0
Alf 1.09 JA
Alfil 8.1.1 Optimized
Amateur 2.82
Amy 0.8.7b DC
Amyan 1.597
AnMon 5.60
Anaconda 2.0.1
Anechka 0.08
Arasan 10.0 64-bit
Arion 1.7
Aristarch 4.50
Armageddon 2.308
Asterisk 0.6
Atlas 2.20
Averno 0.81
Ax 0.8
Ayito 0.2.994
Belzebub 0.67
Bestia 0.90
Betsy 6.51 Nobook
BibiChess 0.5
BigLion 2.23x
Bodo 0.2b
Booot 4.13.1
Bright 0.2c
Bruja 1.9 64-bit JA No-int-book
BugChess2 1.5.2
Cecir 3.5
Celes 0.77c
Cerebro 3.03d
ChessterfieldCL i5a JA
Chezzz 1.0.3
Chispa 4.0.3
Cilian 4.14
Clarabit 1.00 64-bit
Clueless 1.4
Colossus 2007c
Colossus 2007d
Comet B68
Crafty 21.5 64-bit PS
CyberPagno 2.1 32MB
Delfi 5.2
Delfi 5.4
DelphiMax 2.9
Der Bringer 1.9
Diablo 0.5.1 JA
Djinn 0.925x
Dorky 3.48
Dragon 4.6
E.T. Chess 13.01.08
E.T. Chess 18.11.05
EXchess 5.01 beta 64-bit JA
Eagle 0.7.5
Eeyore 1.48
Elephant 1.06
Elf 1.3.0
Enigma 1.1.4
Esc 1.16
Etude 0.1.2
Exacto 0.d
Faile 1.4.4
Fortress 1.62
Francesca MAD 0.13 Nobook
Frenzee 3.0 64-bit
Frenzee Feb08 64-bit
Fritz 5.32
Fritz 6 Light
Fruit 2.3 32-bit
GNU Chess 5.07 64-bit JA
GNU Chess 5.07.9b 64-bit JA
Gaia 3.5 64-bit
Genesis 2.0
Gerbil 02 64-bit JA
Ghost 0.14
Gk 0.90 64-bit JA
Glaurung 1.2.1 64-bit
Glaurung 2.0.1 64-bit
Gosu 0.16
Green Light Chess 3.00
Grizzly 1.40.1b
Gullydeckel 2.16pl1
Hamsters 0.5
Hamsters 0.6
Heracles 0.6.16
Homer 2.01
Horizon 4.4
IACH 0.56z
IQ23 003
InmiChess 3.06N
JanWillem 1.13
Jonny 2.83
Kanguruh 1.93
King of Kings 2.56
KnightDreamer 3.3
KnightX 1.92
Ktulu 4.2
La Dame Blanche 2.0c
LambChop 10.99
Latista (Sinobyl) 1.5
Laurifer 1.0
Leila 0.53h
Lime 66
List 5.12
Little Goliath 3.12 Evolution (TB Off)
Little Goliath 3.12 Evolution (TB On)
Madeleine 0.2
Marvin 1.3.0
Matacz 1.3 HT74 5-men-egbb
Matant 5.04
Matheus 2.3
Matilde 2008 64-bit
Micro-Max 4.8 PIV DM
MiniMardi 1.3
Mizar 3.0
Monarch 1.7
Morphy 3.22
Movei 00.8.403
Movei 00.8.438 (10-10-10)
Muse 0.899b
Mustang 4.97
NagaSkaki 5.12
Natwarlal 0.14
Naum 2.0 32-bit
Naum 2.0 64-bit
Needle 0.53.1
Nejmet 3.07
Nesik 0.7.0 alpha
Parrot 070722
Patzer 3.80
Pepito 1.59 32-bit
Petir 4.39
Petir 4.999999
Phalanx XXII Reborn JA
Pharaon 3.5.1
Piranha 0.5
Popochin 3.2
PostModernist 1016
Pro Deo 1.6
Pseudo 0.7c
Quark 2.35
Queen 4.03
RDChess 3.23
Rainman 0.7.5
Ranita 2.4
Requiem 0.53
Resp 0.19 64-bit JA Nobook
Rival UCI 1.18
Robin 0.983
RomiChess P3k 64-bit
Ruffian 1.0.5
SEE 0.6.9
SOS 5.1
SSEChessII 2.05 DC
Sage 3.53
Scidlet 3.61 64-bit JA
Scorpio 1.91
Scorpio 2.0 32-bit
Sharper 0.17
Simontacchi 1.81
Sjeng 12.13
Slow Chess Blitz WV2.1
Small Potato 0.6.1
SmarThink 0.17a
Smash 1.0.3
SnailChess 4.013
Snitch 1.6.2 32-bit
Soldat 0.25b
Sorgenkind 0.4
SpiderChess 070603
Spike 1.2 Turin
Storm 0.6
Sunsetter C10.3 64-bit JA
Tao 5.6
The Baron 1.8.1
The Baron 2.23 64-bit
The Crazy Bishop 0052
Thinker 4.7a
Thor's Hammer 2.28 32-bit
Trace 1.37a
Twisted Logic 20080404x
Tytan 9.32 64-bit
Ufim 8.02
Uragano 3D 0.87
Uralochka 1.1b
WJChess 1.64
Warrior 1.0.3
WildCat 7
WildCat 8
Wing 2.0a
Yace 0.99.87
Zappa 1.1 64-bit
Zeus 1.29
Zotron 4.4.6