The latest CCRL update (4th September 2010)

[Graham Banks]

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040.live/ (40/40)
http://www.computerchess.org.uk/ccrl/404.live/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are updated separately to each other.
The links given in each update report will give you the currently up to date lists.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.



Our 40 moves in 40 minutes repeating and 40 moves in 4 minutes repeating are both adjusted to the AMD64 X2 4600+ (2.4GHz).

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The LOS (likelihood of superiority) stats to the right hand side of each rating list tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are available for download by engine, by month or by ECO code.
The current ELO ratings are saved in all game databases for those engines that have 200 games or more.

Clicking on an engine name will give details as to opponents played plus homepage links where applicable.

Custom lists of engines can be selected for comparison.

An openings report page lists the number of games played by ECO codes with draw percentage and White win percentage. Clicking on a column heading will sort the list by that column.

For any testers interested in joining our group, please read our homepage before applying.

[ChessKnight]

Graham Banks

The latest CCRL update

I am highly appreciative and thankful to your efforts for regular updates.

thanks.

[Graham Banks]

Graham Banks

The latest CCRL update

I am highly appreciative and thankful to your efforts for regular updates.

thanks.

Thanks. It's a team effort to do all that we do. Producing an update report every two weeks is just one little way I can help the team.

Regards, Graham.

[Mindbreaker]

It would be nice to see a rating for Deep Fritz 11 in the 40/4 category. I love all the stats, results matrices, links to engine homepages, and version comparisons. Great job. I have enjoyed this site for years.

[Graham Banks]

It would be nice to see a rating for Deep Fritz 11 in the 40/4 category. I love all the stats, results matrices, links to engine homepages, and version comparisons. Great job. I have enjoyed this site for years.

Thanks for your kind comments.
I'm sure that the 40/4 testers will read your request. Hopefully one of them might have purchased Deep Fritz 11, but I can't guarantee it. We'll see what we can do.

[Davemt01]

Please excuse me for asking a very basic question. Perhaps it has already been answered somewhere on these forums, but if so, I have been unable to find the answer.

The question is regarding the CPU mentioned in the listings. The abbreviations used for the listing include "single-CPU", "2CPU" and "4CPU", and it's separately mentioned that the CPU in question is the Athlon 64 X2 4600+.

However, the Athlon 64 X2 4600+ is a dual core CPU. Am I correct in assuming, for example, that the top listing, which is:

Rybka 3 64-bit 4CPU

actually means:

Chess engine: Rybka, version 3, 64 bit
OS: some 64 bit OS, probably Windows Vista?
CPU Type: Athlon 64 X2 4600+
CPU Number: 4 separate CPUs, probably on some server-type motherboard? With a total of 8 cores?

By the same token, am I correct in assuming that "2CPU" means two separate Athlon 64 X2 4600+ CPUs (4 cores total)?

I would really appreciate it if I could see a description of the actual hardware, including CPUs, motherboard, amount and type of memory in particular, as well as the name and version of the operating system. Is this information available somewhere?

Thanks.

Dave M.

[Kirill Kryukov]

Please excuse me for asking a very basic question. Perhaps it has already been answered somewhere on these forums, but if so, I have been unable to find the answer.

The question is regarding the CPU mentioned in the listings. The abbreviations used for the listing include "single-CPU", "2CPU" and "4CPU", and it's separately mentioned that the CPU in question is the Athlon 64 X2 4600+.

However, the Athlon 64 X2 4600+ is a dual core CPU. Am I correct in assuming, for example, that the top listing, which is:

Rybka 3 64-bit 4CPU

actually means:

Chess engine: Rybka, version 3, 64 bit
OS: some 64 bit OS, probably Windows Vista?
CPU Type: Athlon 64 X2 4600+
CPU Number: 4 separate CPUs, probably on some server-type motherboard? With a total of 8 cores?

By the same token, am I correct in assuming that "2CPU" means two separate Athlon 64 X2 4600+ CPUs (4 cores total)?

Hi Dave,

"single-CPU", "2CPU" and "4CPU" in fact mean "single-core", "2-core" and "4-core". They are called CPUs because this list started before multi-core CPUs became common. Perhaps it is time to change the wording.

When Athlon 64 X2 4600+ is referred as a reference for 1-CPU testing, it should be taken as "one of the cores of Athlon 64 X2 4600+.

I would really appreciate it if I could see a description of the actual hardware, including CPUs, motherboard, amount and type of memory in particular, as well as the name and version of the operating system. Is this information available somewhere?

Thanks.

Dave M.

We use a broad variety of CPUs, motherboards, and other parts. It is simply not practical to try unifying the hardware. We are not that rich to buy identical machines just for chess, so we use our ordinary machines, whatever we have, for testing.

So, instead we use calibrated time control. We benchmark all of our machines, and adjust the time control so that it becomes close to what it would be on the reference machine (Athlon 64 X2 4600+).

Best,
Kirill

[Davemt01]

Hi Kirill

Thanks very much for the reply. Could you let me know what you use to benchmark the machines, and if this benchmarking software is available to me for testing?

Thanks.

Dave M.

[Kirill Kryukov]

Hi Dave,

You're welcome! For historical reasons, we use Crafty 19.17 BH (Brian Hoffman's compile) as a benchmark. You can get a copy here.

[Davemt01]

I downloaded the benchmark and was able to successfully run it on 3 different machines.

I am interested in chess engines (in a purely amateur/hobbyist way; I have no deep understanding of them), and would like at some point to help in the testing you're using to rate and compare engines. I can see that I still have some reading to do before I fully understand your methodology. I will continue to follow these forums.

Thanks again for the link to Crafty, and for answering my questions.

Dave M.

[Kirill Kryukov]

Hi again, Dave. In this thread you can find discussion about CCRL testing conditions, including details on benchmarking and time control calibration. Good luck!

[guillef]

For the CCRL Team,

I really enjoy using all the information you publish. CCRL is currently the primary source of information to know the progress of each new version of Chronos.

Thank you very much for your efforts in keeping the site updated.

Guillef.

[Graham Banks]

For the CCRL Team,

I really enjoy using all the information you publish. CCRL is currently the primary source of information to know the progress of each new version of Chronos.

Thank you very much for your efforts in keeping the site updated.

Guillef.

Hi Guillef,

Chronos 1.9.6 will pass the 200 game mark in the next update.
Thanks for your kind words.

Cheers,
Graham.

[Mindbreaker]

I am getting a very different result between Rybka 3 Human vs StockFish 1.7.1 than vs Rybka 3. Rybka 3 Human appears to be a more difficult opponent for StockFish 1.7.1 It would be nice if someone official would run a match between these two.

[Shaun Brewer]

I am getting a very different result between Rybka 3 Human vs StockFish 1.7.1 than vs Rybka 3. Rybka 3 Human appears to be a more difficult opponent for StockFish 1.7.1 It would be nice if someone official would run a match between these two.

I am running a head to head R3 v SF1.71 I will also run R3Human and R3Dynamic - Stockfish and R3 a close so lots of games are required for a conclusion one way or the other

Shaun

[Philippe]

Hi all,

It is just for a confirmation please... My processor is an Intel Core i7 940 (2.93 Ghz), I have 12 Gb RAM, I have Windows 7 64 bits. I think it is a quad core... So could you really confirm that it is better for me to buy the Deep Rybka 4?

Multi processor, multi core but... monolithic processor, so it sounds not so easy for me to be sure that the Deep Rybka 4 will be better for me than the "not Deep"

Thank you very much for you answer!

[Quitch]

I'm confused by the pure list in relation to this update. Why, if Deep Fritz 11 has a higher elo than Deep Fritz 10.1, is the latter used on the pure listing?

[Kirill Kryukov]

Hi all,

It is just for a confirmation please... My processor is an Intel Core i7 940 (2.93 Ghz), I have 12 Gb RAM, I have Windows 7 64 bits. I think it is a quad core... So could you really confirm that it is better for me to buy the Deep Rybka 4?

Multi processor, multi core but... monolithic processor, so it sounds not so easy for me to be sure that the Deep Rybka 4 will be better for me than the "not Deep"

Thank you very much for you answer!

Hi Philippe,

Deep Rybka would certainly be better than single-core Rybka on a Core i7 940, but it's more expensive too. Whether it is better for you is something only you can tell, especially with so many strong freeware engines around.

Best,
Kirill

[Kirill Kryukov]

I'm confused by the pure list in relation to this update. Why, if Deep Fritz 11 has a higher elo than Deep Fritz 10.1, is the latter used on the pure listing?

Hi Quitch,

I guess that you are talking about "Deep Fritz 11 4CPU" vs "Deep Fritz 10.1 4CPU". Most probably "Deep Fritz 11 4CPU" did not play enough games with the other participants of the pure list. At least 200 games are required.

Best,
Kirill