CCRL blitz: Free Single-CPU Comparison

Questions and comments related to CCRL testing study
Post Reply
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Updated Free Single-CPU comparison in CCRL 40/4 blitz is available.

The goal of this project is to compare free single-CPU chess engines with large number of games. In this project each participating engine must play at least 30 games match with 16 nearest stronger engines and with 16 nearest weaker engines.

Rating list
Rank Engine ELO + - Score AvOp Games 1 Rybka 1.0 Beta 64-bit 2946 +17 -16 74.7% -180.6 1492 2 Fruit 2.3 2875 +20 -19 67.2% -121.7 959 3 Glaurung 2.0.1 64-bit 2838 +11 -11 52.3% -16.7 2897 4 Spike 1.2 Turin 2825 +6 -6 46.0% +27.2 11574 5 Naum 2.0 32-bit 2795 +8 -8 48.8% +3.6 5964 6 Bright 0.2c 2786 +15 -15 45.3% +35.0 1677 7 Alaric 707 2761 +11 -11 46.3% +25.3 3136 8 Scorpio 2.0 32-bit 2747 +11 -11 50.5% -2.4 3083 9 Movei 00.8.438(10 10 10) 2731 +15 -15 48.7% +9.5 1713 10 E.T. Chess 13.01.08 2729 +22 -22 51.0% -4.4 695 11 Pro Deo 1.2 2720 +12 -12 42.9% +52.9 2659 12 Frenzee 3.0 64-bit 2713 +14 -14 49.7% +1.9 1764 13 Slow Chess Blitz WV2.1 2712 +8 -8 41.4% +61.9 6337 14 Delfi 5.2 2710 +12 -12 41.6% +60.9 2694 15 Zappa 1.1 64-bit 2709 +15 -15 47.1% +20.7 1632 16 WildCat 7 2701 +9 -9 46.6% +23.2 4503 17 Pharaon 3.5.1 2700 +11 -11 38.8% +81.6 3515 18 List 5.12 2693 +11 -11 48.7% +9.1 3086 19 Colossus 2007c 2683 +15 -15 46.8% +23.2 1568 20 SOS 5.1 2682 +12 -12 46.7% +23.1 2729 21 Ruffian 1.0.5 2677 +12 -12 49.4% +4.3 2478 22 Pseudo 0.7c 2675 +11 -11 50.1% -4.1 3189 23 Booot 4.13.1 2669 +13 -13 51.5% -10.9 1968 24 Aristarch 4.50 2667 +12 -11 45.8% +31.2 2835 25 Hamsters 0.6 2659 +15 -15 51.0% -7.0 1477 26 Petir 4.999999 2657 +15 -15 47.5% +17.0 1476 27 Jonny 2.83 32-bit 2650 +13 -13 46.1% +29.9 2076 28 The Baron 1.8.1 2648 +15 -15 48.8% +8.8 1587 29 Crafty 21.5 PS 64-bit 2643 +14 -14 45.4% +33.5 1711 30 BugChess2 1.5.2 2642 +15 -16 50.2% -2.9 1440 31-32 Anaconda 2.0.1 2639 +13 -13 50.7% -4.2 2125 31-32 Fritz 5.32 2639 +14 -14 52.5% -20.1 1909 33 Smarthink 0.17a 2635 +14 -14 50.7% -5.4 1690 34 Thinker 4.7a 2632 +12 -12 50.6% -7.9 2567 35 Ktulu 4.2 2631 +16 -16 52.5% -18.0 1405 36 Ufim 8.02 2619 +12 -11 51.4% -12.3 2843 37 AnMon 5.60 2613 +13 -13 49.3% +5.9 2084 38 Trace 1.37a 2612 +14 -14 47.7% +17.0 1864 39-40 Little Goliath Evolution 3.12 (TB On) 2610 +16 -16 50.4% -2.6 1343 39-40 Yace 0.99.87 2610 +16 -16 50.8% -6.2 1312 41 Green Light Chess 3.00 2577 +18 -18 47.8% +13.5 1086 42 Tao 5.6 2564 +18 -18 46.1% +26.9 1079 43 Amyan 1.597 2561 +13 -13 46.0% +27.5 2184 44 Abrok 5.0 2559 +17 -17 47.4% +13.7 1180 45 SpiderChess 070603 2556 +14 -14 46.2% +26.6 1936 46 Arasan 10.0 64-bit 2550 +19 -19 45.2% +33.3 957 47 Pepito 1.59 64-bit JA 2546 +21 -21 46.4% +23.0 768 48 Kiwi 0.6d 2518 +17 -17 45.7% +29.7 1259 49 Snitch 1.6.2 32-bit 2516 +19 -19 42.8% +50.4 1034 50 Nejmet 3.07 2514 +16 -16 44.0% +42.4 1477 51 Quark 2.35 2513 +18 -18 42.5% +54.7 1098 52 Dragon 4.6 2503 +16 -16 41.5% +65.6 1454 53 Comet B68 2479 +19 -19 38.3% +83.4 1045 54 Sjeng 12.13 2477 +21 -21 35.9% +100.1 832
Links
Recent news

Delfi 5.2 (by Fabio Cavicchio) substituted version 5.1 in the list. It does not look like a noticeable improvement: Comparison. Delfi 5.1 is higher rated at the moment. This is consistent with CCRL 40/40 results. I will still keep testing and listing the 5.2 version. It is currently 14-th strongest free single-CPU engine.

Petir 4.999999 (by Peter Alloysius) substituted version 4.39 in the list. It is rated slightly lower than Petir 4.39 at the moment: Comparison. This is consistent with CCRL 40/40 results to date. I will continue testing and listing the 4.999999 version, which is 26-th strongest free single-CPU engine.

Dragon 4.6 by Bruno Lucas was tested and entered the list as 52-nd strongest free single CPU engine! (Dragon 4.6 results so far)

E.T. Chess 13.01.08 by Eric Triki is currently under testing. (13.01.08 is a confusing way to say 2008-01-13). So far it looks like a great improvement of more than 100 ELO points over E.T. Chess 18.11.05. By the way, this is an update interval of about two years. I personally really like this update schedule. E.T. Chess 13.01.08 is currently 10-th strongest free single-CPU engine.

Future

Many listed engines have updated versions, and many more engines still need testing. These are near the top of my list of engines to test:
  • Colossus 2007d
  • Crafty 22.0 64-bit 1-CPU
  • Frenzee Feb08 64-bit 1-CPU
  • Booot 4.14.0
  • Thinker 5.1c
  • Wildcat 8
  • Arasan 10.3
  • Alfil 8.1.1
If you think some other free single-CPU engine can compete for the place in top 50, please tell me!

Note 1. Pro Deo 1.2 (latest public version) does not run on machine with 4 GB of RAM, that's why I can't test it and it has many gaps in the table.

Note 2. I am not interested in Strelka, Toga and Sloppy.
User avatar
Gabor Szots
Posts: 12828
Joined: Sat Dec 09, 2006 6:30 am
Sign-up code: 10159
Location: Szentendre, Hungary

Re: CCRL blitz: Free Single-CPU Comparison

Post by Gabor Szots »

Kirill Kryukov wrote:By the way, this is an update interval of about two years. I personally really like this update schedule.
I go along similar lines. My current policy is to test only engines that are not older than 2 years (I would not want to test dead engines).
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Gabor Szots wrote:
Kirill Kryukov wrote:By the way, this is an update interval of about two years. I personally really like this update schedule.
I go along similar lines. My current policy is to test only engines that are not older than 2 years (I would not want to test dead engines).
I am quite happy to test dead engines. :-)
User avatar
Gabor Szots
Posts: 12828
Joined: Sat Dec 09, 2006 6:30 am
Sign-up code: 10159
Location: Szentendre, Hungary

Re: CCRL blitz: Free Single-CPU Comparison

Post by Gabor Szots »

Kirill Kryukov wrote:
Gabor Szots wrote:
Kirill Kryukov wrote:By the way, this is an update interval of about two years. I personally really like this update schedule.
I go along similar lines. My current policy is to test only engines that are not older than 2 years (I would not want to test dead engines).
I am quite happy to test dead engines. :-)
I am glad to see our interests differ - we are not filling the same gaps.
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Updated comparison:
CCRL 40/4 Rating List - Custom engine selection 296259 games played by 603 programs, run by 10 testers Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz) Computed on June 6, 2008 with Bayeselo based on 296'259 games Tested by CCRL team, 2005-2008, http://computerchess.org.uk/ccrl/404/ Rank Engine ELO + - Score AvOp Games 1 Rybka 1.0 Beta 64-bit 2944 +16 -16 74.9% -182.2 1620 2 Fruit 2.3 2881 +18 -18 68.6% -131.8 1087 3 Glaurung 2.0.1 64-bit 2836 +9 -9 48.0% +13.0 4747 4 Spike 1.2 Turin 2826 +5 -6 44.4% +37.5 14075 5 Naum 2.0 32-bit 2794 +8 -8 48.9% +2.7 6092 6 Bright 0.2c 2785 +14 -14 45.8% +30.5 1803 7 Alaric 707 2759 +10 -10 44.8% +35.7 3843 8 Scorpio 2.0 32-bit 2746 +10 -10 50.7% -3.9 3179 9 Movei 00.8.438(10 10 10) 2737 +13 -13 49.0% +6.8 2007 10 E.T. Chess 13.01.08 2728 +15 -15 47.5% +19.5 1605 11 Alfil 8.1.1 Optimized 2723 +19 -19 51.0% -6.5 992 12 Pro Deo 1.6(2007-11-14) 2716 +20 -20 48.0% +15.4 864 13-14 Colossus 2007d 2713 +14 -14 46.1% +28.8 1930 13-14 Frenzee 3.0 64-bit 2713 +14 -14 49.7% +1.7 1828 15 Slow Chess Blitz WV2.1 2711 +8 -8 41.5% +62.0 6497 16 Delfi 5.2 2710 +11 -11 41.5% +61.6 3077 17 Zappa 1.1 64-bit 2709 +14 -14 47.2% +19.9 1728 18 WildCat 7 2701 +9 -9 46.7% +22.6 4599 19 Pharaon 3.5.1 2699 +11 -10 39.2% +80.2 3642 20 List 5.12 2692 +11 -11 48.5% +10.9 3214 21 SOS 5.1 2682 +12 -12 46.7% +23.9 2857 22 Ruffian 1.0.5 2679 +12 -12 49.2% +4.4 2606 23 Pseudo 0.7c 2676 +11 -11 50.0% -3.1 3317 24 Booot 4.13.1 2668 +13 -13 51.0% -6.9 2096 25 Aristarch 4.50 2667 +11 -11 45.7% +32.5 2962 26 Hamsters 0.6 2660 +14 -14 49.9% +0.8 1685 27 Petir 4.999999 2659 +14 -14 48.2% +11.6 1699 28 Jonny 2.83 32-bit 2650 +13 -13 45.9% +31.4 2172 29 The Baron 1.8.1 2648 +15 -15 48.7% +9.5 1683 30 Crafty 21.5 PS 64-bit 2642 +14 -14 45.7% +32.0 1743 31 BugChess2 1.5.2 2641 +15 -15 50.3% -2.9 1568 32-33 Anaconda 2.0.1 2639 +13 -13 50.8% -5.5 2157 32-33 Fritz 5.32 2639 +13 -13 52.9% -22.4 1973 34 Smarthink 0.17a 2634 +14 -14 50.8% -6.3 1722 35-36 Ktulu 4.2 2632 +16 -16 53.0% -20.9 1437 35-36 Thinker 4.7a 2632 +12 -12 50.8% -9.1 2599 37 Ufim 8.02 2622 +11 -11 51.2% -10.9 3051 38 Trace 1.37a 2612 +14 -14 48.1% +14.4 1928 39 AnMon 5.60 2611 +13 -13 49.2% +6.6 2116 40 Yace 0.99.87 2609 +16 -16 50.5% -4.1 1376 41 Little Goliath Evolution 3.12 2608 +12 -12 52.7% -21.1 2462 42 Green Light Chess 3.00 2573 +17 -17 46.7% +21.3 1182 43-44 Abrok 5.0 2561 +17 -17 47.3% +13.3 1244 43-44 Amyan 1.597 2561 +13 -13 46.1% +27.1 2216 45 Tao 5.6 2559 +18 -18 45.4% +32.2 1143 46 SpiderChess 070603 2553 +13 -13 46.6% +23.6 2096 47-48 Arasan 10.0 64-bit 2550 +19 -18 45.4% +31.5 989 47-48 Twisted Logic 20080404x 2550 +21 -21 47.1% +20.4 800 49 Pepito 1.59 64-bit 2542 +19 -18 46.4% +23.8 991 50 Kiwi 0.6d 2519 +17 -17 45.8% +29.1 1291 51 Nejmet 3.07 2517 +16 -16 44.4% +39.3 1509 52 Snitch 1.6.2 32-bit 2513 +18 -18 42.6% +52.6 1066 53 Quark 2.35 2511 +18 -18 42.3% +55.9 1130 54 Dragon 4.6 2505 +16 -16 41.7% +63.1 1486 55 Sjeng 12.13 2475 +20 -21 35.9% +100.3 864 56 Comet B68 2474 +17 -18 39.0% +78.9 1208
Rating list and cross-tables
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Updated on June 28. Now 57 free single-CPU engines are ranked in this tournament! The latest addition was Matacz 1.3 HT74, which entered the list at #50.
Rank Engine ELO + - Score AvOp Games 1 Rybka 1.0 Beta 64-bit 2945 +16 -16 74.9% -182.6 1620 2 Fruit 2.3 2882 +18 -18 68.6% -132.2 1087 3 Glaurung 2.0.1 64-bit 2837 +8 -9 47.5% +15.4 4945 4 Spike 1.2 Turin 2826 +6 -6 44.1% +39.7 14426 5 Naum 2.0 32-bit 2794 +8 -8 48.9% +3.4 6092 6 Bright 0.2c 2786 +14 -14 45.8% +30.2 1803 7 Alaric 707 2759 +10 -10 44.5% +38.1 3899 8 Scorpio 2.0 32-bit 2746 +10 -10 50.7% -3.5 3179 9 Movei 00.8.438(10 10 10) 2736 +13 -13 48.3% +12.8 2063 10 E.T. Chess 13.01.08 2728 +15 -15 47.2% +22.0 1629 11 Alfil 8.1.1 Optimized 2723 +19 -19 51.0% -5.9 992 12 Pro Deo 1.6(2007-11-14) 2717 +20 -20 48.0% +15.0 864 13 Colossus 2007d 2714 +14 -14 45.4% +32.9 1985 14 Frenzee 3.0 64-bit 2713 +14 -14 49.7% +2.2 1828 15 Slow Chess Blitz WV2.1 2712 +8 -8 41.5% +61.6 6497 16 Delfi 5.2 2711 +11 -11 41.1% +63.7 3132 17 Zappa 1.1 64-bit 2710 +14 -14 47.2% +19.6 1728 18 WildCat 7 2702 +9 -9 46.7% +22.2 4599 19 Pharaon 3.5.1 2700 +11 -10 39.2% +79.9 3642 20 List 5.12 2693 +11 -11 48.5% +10.6 3214 21 SOS 5.1 2683 +11 -12 46.7% +23.5 2857 22 Ruffian 1.0.5 2679 +12 -12 49.2% +5.0 2606 23 Pseudo 0.7c 2676 +10 -11 50.0% -2.5 3317 24 Booot 4.13.1 2669 +13 -13 51.0% -7.3 2096 25 Aristarch 4.50 2668 +11 -11 45.7% +32.1 2962 26 Hamsters 0.6 2661 +14 -14 50.3% -2.2 1708 27 Petir 4.999999 2660 +14 -14 48.7% +8.4 1723 28 Jonny 2.83 32-bit 2651 +13 -13 45.9% +31.1 2172 29 The Baron 1.8.1 2649 +15 -15 49.1% +6.4 1707 30 Crafty 21.5 PS 64-bit 2643 +14 -14 45.7% +31.8 1743 31-33 Anaconda 2.0.1 2640 +13 -13 51.1% -7.1 2189 31-33 BugChess2 1.5.2 2640 +15 -15 50.6% -5.7 1624 31-33 Fritz 5.32 2640 +13 -13 53.1% -23.9 2005 34-35 Ktulu 4.2 2633 +16 -15 53.0% -21.0 1437 34-35 Smarthink 0.17a 2633 +14 -14 50.9% -6.1 1754 36 Thinker 4.7a 2632 +12 -12 50.8% -8.3 2599 37 Ufim 8.02 2624 +11 -11 51.6% -14.1 3107 38 Trace 1.37a 2612 +14 -14 48.3% +13.8 1960 39 AnMon 5.60 2611 +13 -13 49.3% +6.3 2148 40-41 Little Goliath Evolution 3.12 2609 +12 -12 52.8% -21.9 2494 40-41 Yace 0.99.87 2609 +16 -16 50.6% -4.8 1408 42 Green Light Chess 3.00 2574 +17 -17 47.0% +19.7 1214 43 Abrok 5.0 2562 +17 -17 47.5% +12.2 1275 44-45 Amyan 1.597 2561 +13 -13 46.1% +27.0 2248 44-45 Tao 5.6 2561 +17 -17 45.7% +29.5 1175 46 Arasan 10.0 64-bit 2554 +18 -18 46.2% +26.9 1021 47 Twisted Logic 20080404x 2553 +21 -21 47.6% +16.9 832 48 SpiderChess 070603 2552 +13 -13 46.7% +23.5 2151 49 Pepito 1.59 64-bit 2542 +18 -18 46.4% +23.8 1023 50 Matacz 1.3 HT74 2538 +21 -21 45.9% +28.7 766 51 Kiwi 0.6d 2520 +17 -17 45.9% +28.7 1323 52 Nejmet 3.07 2518 +16 -16 44.4% +38.7 1540 53 Snitch 1.6.2 32-bit 2514 +18 -18 42.7% +51.6 1098 54 Quark 2.35 2513 +18 -18 42.5% +53.9 1162 55 Dragon 4.6 2504 +16 -16 41.6% +64.2 1518 56 Comet B68 2477 +17 -17 39.5% +74.6 1264 57 Sjeng 12.13 2476 +20 -20 36.1% +98.8 896
Link to the rating list and cross-tables
User avatar
Edsel Apostol
Posts: 2
Joined: Wed Jul 25, 2007 3:30 am
Sign-up code: 0
Location: Philippines
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Edsel Apostol »

Hi Kirill,

Please include the latest Twisted Logic version. It might get in the top 10, even the top 5 if it is lucky.
Thanks.

Edsel Apostol
Twisted Logic Regards,
Edsel Apostol
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Edsel Apostol wrote:Hi Kirill,

Please include the latest Twisted Logic version. It might get in the top 10, even the top 5 if it is lucky.
Thanks.

Edsel Apostol
Hi Edsel, thanks for update and interest! I saw some results of new Twisted Logic and I am very impressed! I already added it to my testing queue, but I'm afraid it will take some time before I can test it. I do this mostly on my own, and my testing is relatively thorough to get reliable rankings. So it takes time, and there are other engines waiting on my queue. Though it may be sooner if other CCRL members have interest and test it too.
User avatar
Edsel Apostol
Posts: 2
Joined: Wed Jul 25, 2007 3:30 am
Sign-up code: 0
Location: Philippines
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Edsel Apostol »

Thanks Kirill. It's ok if it would be for a while that you could test my engine. I'm not in a hurry anyway.

I think that the programmers just can't give thanks enough for the great effort of the rating lists like CCRL for using their CPU time testing our engines.

Since testing takes a lot of time and since strength in different time controls seems to correlate with each other, it might be better to use shorter time controls to have more games in a short time. My suggestion is to have a new rating list maybe based on a 10' + 10" time control or 20' + 20" time control instead of 40/40. It would produce reasonable number of games in a short time and the Fisher time control format I think is much better compared to the x moves in y minutes format.
Twisted Logic Regards,
Edsel Apostol
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

As the thread title indicates, this particular comparison is done in CCRL blitz time control - 40 moves in 4 minutes repeated. :-) (CCRL 40/4 about page)
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Blitz time control is what makes this comparison possible at all. I attempted the same thing in 40/40 long ago but it was too slow to be anywhere close to practical.

Currently Der Bringer 1.9 is under testing. The next engines at the front of my queue are: Phalanx XXII, LambChop 10.99, King of Kings 2.56.
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Update: Now 68 free single-CPU engines are ranked.
_Rank Engine ELO + - Score AvOp Games 1 Fruit 2.3 2881 +19 -18 68.6% -132.2 1087 2 Glaurung 2.0.1 64-bit 2835 +9 -9 47.0% +19.3 5425 3 Spike 1.2 Turin 2825 +6 -6 43.5% +45.2 16892 4 Naum 2.0 32-bit 2793 +8 -8 48.9% +3.3 6092 5 Bright 0.2c 2788 +13 -13 48.1% +14.7 2123 6 Alaric 707 2759 +10 -10 44.5% +40.0 4506 7 Scorpio 2.0 32-bit 2745 +10 -10 50.8% -4.1 3530 8 E.T. Chess 13.01.08 2733 +12 -12 48.5% +12.6 2525 9 Movei 00.8.438(10 10 10) 2731 +12 -12 47.2% +21.8 2643 10 Alfil 8.1.1 Optimized 2726 +15 -15 47.9% +17.6 1594 11-12 Frenzee 3.0 64-bit 2713 +14 -14 49.8% +1.4 1860 11-12 Pro Deo 1.6(2007-11-14) 2713 +19 -19 48.5% +11.5 992 13-14 Colossus 2007d 2711 +12 -12 46.6% +25.0 2648 13-14 Slow Chess Blitz WV2.1 2711 +8 -8 41.7% +60.5 7277 15-16 Delfi 5.2 2709 +10 -10 41.8% +59.0 3548 15-16 Zappa 1.1 64-bit 2709 +14 -14 47.2% +19.5 1728 17 WildCat 7 2701 +9 -9 46.9% +20.9 4885 18 Pharaon 3.5.1 2699 +10 -10 39.2% +78.9 3737 19 List 5.12 2691 +10 -11 48.2% +13.1 3406 20 SOS 5.1 2682 +11 -11 46.8% +22.6 2985 21 Ruffian 1.0.5 2678 +11 -12 49.3% +4.2 2766 22 Pseudo 0.7c 2674 +10 -11 49.8% -1.2 3477 23 Aristarch 4.50 2667 +11 -11 46.0% +30.4 3089 24 Booot 4.13.1 2666 +13 -13 51.3% -8.8 2191 25 Hamsters 0.6 2662 +13 -13 51.4% -9.8 1963 26 Petir 4.999999 2658 +13 -13 50.4% -3.6 2167 27 Jonny 2.83 32-bit 2651 +12 -12 46.9% +22.8 2428 28 The Baron 1.8.1 2644 +14 -14 48.5% +10.2 1969 29 BugChess2 1.5.2 2643 +14 -14 51.0% -8.8 1816 30 Fritz 5.32 2642 +13 -13 53.2% -24.9 2132 31 Crafty 21.5 PS 64-bit 2640 +14 -14 45.7% +32.2 1871 32 Anaconda 2.0.1 2639 +12 -12 51.1% -6.8 2413 33-34 Ktulu 4.2 2634 +15 -15 53.4% -24.9 1597 33-34 Thinker 4.7a 2634 +11 -11 51.6% -14.1 2919 35 SmarThink 0.17a 2631 +14 -14 50.8% -6.4 1882 36 Ufim 8.02 2627 +10 -10 53.1% -25.6 3729 37 AnMon 5.60 2614 +13 -13 50.1% +0.2 2340 38 Trace 1.37a 2612 +13 -13 50.5% -3.0 2384 39 Yace 0.99.87 2610 +15 -15 52.1% -15.3 1600 40 Little Goliath Evolution 3.12 (TB On) 2609 +16 -16 50.3% -2.1 1375 41 Pepito 1.59 32-bit 2592 +18 -18 50.1% -0.6 1088 42 Green Light Chess 3.00 2573 +15 -15 48.4% +10.2 1470 43 Tao 5.6 2569 +15 -15 48.9% +6.7 1493 44 Twisted Logic 20080404x 2564 +17 -17 50.5% -3.9 1280 45-46 Abrok 5.0 2560 +15 -14 49.9% -2.8 1723 45-46 Arasan 10.0 64-bit 2560 +16 -16 49.4% +3.8 1373 47 Amyan 1.597 2559 +12 -12 47.6% +16.8 2759 48 SpiderChess 070603 2548 +11 -11 48.7% +9.3 2944 49 Matacz 1.3 HT74 2545 +17 -17 49.7% +2.1 1213 50 King of Kings 2.56 2539 +18 -18 49.7% +0.1 1152 51 LambChop 10.99 2530 +15 -15 49.1% +6.9 1615 52 Quark 2.35 2524 +15 -14 47.7% +16.7 1738 53 Snitch 1.6.2 32-bit 2517 +15 -15 46.8% +22.8 1546 54-55 Dragon 4.6 2515 +13 -13 45.7% +33.3 2094 54-55 Nejmet 3.07 2515 +13 -14 46.8% +22.6 2052 56 KnightDreamer 3.3 2509 +19 -19 48.7% +7.4 988 57 Francesca MAD 0.13 Nobook 2497 +20 -20 48.5% +9.6 893 58 Amy 0.8.7b DC 2482 +20 -20 46.1% +27.5 928 59-60 Comet B68 2474 +14 -14 43.1% +49.5 1957 59-60 Muse 0.899b 2474 +14 -14 50.4% -4.8 1783 61 Der Bringer 1.9 2473 +14 -14 47.1% +21.6 1896 62 Sjeng 12.13 2469 +17 -17 39.8% +72.5 1311 63 Djinn 0.925x 2461 +14 -14 45.0% +35.3 1815 64 Crazy Bishop 0052 2455 +21 -21 43.7% +44.8 799 65 Amateur 2.82 2448 +15 -15 43.5% +49.2 1780 66 Phalanx XXII Reborn JA 2429 +20 -20 39.3% +77.4 895 67 Thor's Hammer 2.28 32-bit 2415 +22 -22 43.5% +48.4 781 68 EXchess 5.01 64-bit 2347 +26 -27 31.4% +135.2 544
Rating list and crosstable at CCRL 40/4 site

Recently added engines: Der Bringer 1.9, Phalanx XXII Reborn JA, LambChop 10.99, Amy 0.8.7b DC, King of Kings 2.56, The Crazy Bishop 0052, KnightDreamer 3.3, Muse 0.899b, Amateur 2.82, Francesca MAD 0.13 Nobook, Thor's Hammer 2.28 32-bit, EXchess 5.01 beta 64-bit JA, Djinn 0.925x.

32-bit compile of Pepito 1.59 is now listed, because 64-bit compile is suffering from EGTB bug.

Removed engines: Kiwi as predecessor of Hamsters, Rybka 1.0 because of continuing controversy.
User avatar
Graham Banks
Posts: 26885
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: CCRL blitz: Free Single-CPU Comparison

Post by Graham Banks »

Kirill Kryukov wrote: Removed engines: Kiwi as predecessor of Hamsters, Rybka 1.0 because of continuing controversy.
I thought that the Rybka 1.0 issue had gone away. Haven't read anything for quite a while now.
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Graham Banks wrote:
Kirill Kryukov wrote: Removed engines: Kiwi as predecessor of Hamsters, Rybka 1.0 because of continuing controversy.
I thought that the Rybka 1.0 issue had gone away. Haven't read anything for quite a while now.
I also haven't seen anything new about this issue for a while now.
User avatar
Kirill Kryukov
Site Admin
Posts: 7399
Joined: Sun Dec 18, 2005 9:58 am
Sign-up code: 0
Location: Mishima, Japan
Contact:

Re: CCRL blitz: Free Single-CPU Comparison

Post by Kirill Kryukov »

Update: Following engines were tested and added into comparison:
  • Leila 0.53h (by Carmelo Calzerano, Italy, 2002) - shares ranks 63‑64 with Djinn 0.925x.
  • Scidlet 3.61 x64 JA (by Shane Hudson, New Zealand, 2004) - ranked 69.
  • Eeyore 1.48 (Anton Maydell, Russia, 2004) - ranked 70.
Updated selection from CCRL 40/4 rating list: Rank Engine ELO + - Score AvOp Games 1 Fruit 2.3 2882 +18 -18 68.6% -132.7 1087 2 Glaurung 2.0.1 64-bit 2836 +8 -8 47.0% +18.8 5425 3 Spike 1.2 Turin 2825 +5 -5 43.3% +47.2 17180 4 Naum 2.0 32-bit 2794 +8 -8 48.9% +2.9 6092 5 Bright 0.2c 2788 +13 -13 48.1% +15.1 2123 6 Alaric 707 2759 +10 -9 44.2% +42.6 4538 7 Scorpio 2.0 32-bit 2746 +10 -10 50.8% -4.4 3530 8 E.T. Chess 13.01.08 2733 +12 -12 48.0% +17.5 2557 9 Movei 00.8.438(10 10 10) 2732 +12 -12 46.8% +25.5 2675 10 Alfil 8.1.1 Optimized 2726 +15 -15 47.1% +25.2 1626 11 Frenzee 3.0 64-bit 2714 +14 -14 49.8% +0.9 1860 12 Pro Deo 1.6(2007-11-14) 2713 +19 -19 48.5% +12.1 992 13 Slow Chess Blitz WV2.1 2712 +7 -8 41.6% +61.5 7309 14 Colossus 2007d 2711 +12 -12 46.6% +25.6 2648 15 Zappa 1.1 64-bit 2710 +14 -14 47.2% +19.1 1728 16 Delfi 5.2 2709 +10 -10 41.8% +59.5 3548 17 WildCat 7 2701 +9 -9 46.9% +21.5 4885 18 Pharaon 3.5.1 2699 +10 -10 39.2% +79.4 3737 19 List 5.12 2692 +11 -10 48.2% +12.7 3406 20 SOS 5.1 2683 +11 -11 46.8% +22.2 2985 21 Ruffian 1.0.5 2679 +12 -12 49.3% +3.7 2766 22 Pseudo 0.7c 2675 +11 -10 49.8% -1.5 3477 23-24 Aristarch 4.50 2667 +11 -11 46.0% +30.9 3089 23-24 Booot 4.13.1 2667 +13 -13 51.3% -9.2 2191 25 Hamsters 0.6 2663 +14 -13 51.4% -10.1 1963 26 Petir 4.999999 2658 +12 -12 49.6% +3.3 2291 27 Jonny 2.83 32-bit 2652 +12 -12 46.9% +22.5 2428 28 The Baron 1.8.1 2645 +14 -14 48.5% +9.8 1969 29 BugChess2 1.5.2 2644 +14 -14 51.0% -9.0 1816 30 Fritz 5.32 2643 +13 -13 53.2% -25.3 2132 31 Crafty 21.5 PS 64-bit 2641 +14 -14 45.7% +31.8 1871 32 Anaconda 2.0.1 2640 +12 -12 51.1% -7.1 2413 33 Thinker 4.7a 2635 +11 -11 51.6% -14.3 2919 34 Ktulu 4.2 2634 +15 -15 53.4% -24.1 1597 35 SmarThink 0.17a 2631 +14 -14 50.8% -5.7 1882 36 Ufim 8.02 2628 +10 -10 53.1% -24.8 3821 37 AnMon 5.60 2615 +13 -13 50.1% -0.0 2340 38-39 Trace 1.37a 2611 +12 -12 50.1% +0.0 2475 38-39 Yace 0.99.87 2611 +15 -15 52.1% -15.5 1600 40 Little Goliath Evolution 3.12 (TB On) 2610 +16 -16 50.3% -2.4 1375 41 Pepito 1.59 32-bit 2592 +18 -18 50.1% -0.1 1088 42 Green Light Chess 3.00 2574 +15 -15 48.4% +9.9 1470 43 Tao 5.6 2570 +16 -16 48.9% +6.5 1493 44 Twisted Logic 20080404x 2565 +17 -17 50.5% -4.0 1280 45-46 Abrok 5.0 2561 +14 -15 49.9% -3.0 1723 45-46 Arasan 10.0 64-bit 2561 +16 -16 49.4% +3.6 1373 47 Amyan 1.597 2560 +12 -12 47.6% +16.6 2759 48 SpiderChess 070603 2548 +11 -11 48.5% +10.3 3008 49 Matacz 1.3 HT74 2544 +17 -17 49.8% +1.9 1245 50 King of Kings 2.56 2540 +17 -17 50.1% -2.1 1184 51 LambChop 10.99 2532 +15 -15 49.0% +7.3 1679 52 Quark 2.35 2524 +14 -14 48.2% +13.2 1802 53 Nejmet 3.07 2518 +13 -13 48.0% +14.2 2148 54 Snitch 1.6.2 32-bit 2516 +15 -15 47.7% +16.5 1642 55 Dragon 4.6 2514 +13 -13 46.0% +31.2 2158 56 KnightDreamer 3.3 2509 +18 -18 50.1% -1.9 1084 57 Francesca MAD 0.13 Nobook 2494 +19 -19 49.3% +3.5 989 58 Amy 0.8.7b DC 2487 +19 -19 48.0% +13.2 1024 59 Comet B68 2476 +13 -13 43.7% +44.9 2085 60 Sjeng 12.13 2475 +16 -16 41.9% +57.7 1406 61-62 Der Bringer 1.9 2474 +14 -14 47.3% +19.7 2024 61-62 Muse 0.899b 2474 +14 -14 50.2% -3.7 1909 63-64 Djinn 0.925x 2464 +14 -14 45.7% +31.1 1943 63-64 Leila 0.53h 2464 +22 -22 48.4% +11.3 735 65 Crazy Bishop 0052 2458 +20 -20 45.4% +32.2 895 66 Amateur 2.82 2449 +14 -14 44.2% +44.2 1876 67 Phalanx XXII Reborn JA 2432 +19 -19 40.9% +65.3 990 68 Thor's Hammer 2.28 32-bit 2413 +21 -21 44.0% +44.7 876 69 Scidlet 3.61 x64 JA 2373 +24 -25 37.0% +93.3 607 70 Eeyore 1.48 2365 +26 -26 36.9% +95.5 541 71 EXchess 5.01 64-bit 2352 +24 -24 33.7% +119.0 640
Comparison at CCRL 40/4
Post Reply