The latest CCRL update (7th September 2024)

Questions and comments related to CCRL testing study
Ray
Posts: 22607
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: The latest CCRL update (10th December 2022)

Post by Ray »

Yes, as I said, different tester, different hardware, different book, different GUI and even a different compile of Stockfish 15.1. But the large error margins are surely the dominant factor. +/- 20 Elo or so on each engine with the low number of games.

Stockfish 15.1 on one thread was tested:
Intel i9 10900
bmi2 compile
Pohl SuperGM 4Moves book
Cutechess GUI
Peter
Posts: 2
Joined: Sun May 14, 2023 5:30 am
Sign-up code: 10159

Re: The latest CCRL update (13th May 2023)

Post by Peter »

I've found a bug in Aprils Rating List: https://ccrl.chessdom.com/ccrl/4040/gam ... 47].pgn.7z
EloValues for three engines seem to be missing:
KnightX 3.7b 64-bit - , e.g. in Round:874.2.29
Zangdar 2.15.03 64-bit - e.g. in Round:875.1.883
Renegade 0.10.0 64-bit - e.g. in Round:875.1.932

I haven't checked any other files yet, and don't know whether this bug is already known, but hope I can help with this reporting.
Ray
Posts: 22607
Joined: Sun Dec 18, 2005 6:33 pm
Sign-up code: 10159
Location: NZ

Re: The latest CCRL update (13th May 2023)

Post by Ray »

Possibly because there are not enough games for a reliable rating.

You mean games played in April, not the April ratings list ?
Peter
Posts: 2
Joined: Sun May 14, 2023 5:30 am
Sign-up code: 10159

Re: The latest CCRL update (13th May 2023)

Post by Peter »

Yes, it's in the PGN-Files of the games (the one I linked above), not in the rating list.
othoma
Posts: 6
Joined: Sun Dec 11, 2016 8:32 am
Sign-up code: 10159

Re: The latest CCRL update (15th December 2023)

Post by othoma »

Fritz 19 :?:
User avatar
Graham Banks
Posts: 27536
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: The latest CCRL update (15th December 2023)

Post by Graham Banks »

othoma wrote: Sat Dec 16, 2023 5:47 amFritz 19 :?:
Ginkgo Valencia 1.01. :thumbup:
crsder
Posts: 2
Joined: Tue Nov 07, 2023 10:29 pm
Sign-up code: 10159

Re: The latest CCRL update (15th December 2023)

Post by crsder »

Hello, author of Austerlitz here.
On 4 December I shared Austerlitz version 1.4.7 and asked for testing it, but I still haven't got any return information about it.
Actually, I hoped to see it appeared on the next ranking list. Could I know how Austerlitz testing is going and when could I possibly expect to get estimated elo of the engine? I noticed given ccrl links don't work, at least on my device.
othoma
Posts: 6
Joined: Sun Dec 11, 2016 8:32 am
Sign-up code: 10159

Re: The latest CCRL update (15th December 2023)

Post by othoma »

Graham Banks wrote: Sat Dec 16, 2023 5:49 am
othoma wrote: Sat Dec 16, 2023 5:47 amFritz 19 :?:
Ginkgo Valencia 1.01. :thumbup:
Nobody knows it, could you link Ginko to Fritz ?
User avatar
Graham Banks
Posts: 27536
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: The latest CCRL update (15th December 2023)

Post by Graham Banks »

othoma wrote: Sun Dec 17, 2023 9:52 pm
Graham Banks wrote: Sat Dec 16, 2023 5:49 am
othoma wrote: Sat Dec 16, 2023 5:47 amFritz 19 :?:
Ginkgo Valencia 1.01. :thumbup:
Nobody knows it, could you link Ginko to Fritz ?
I'm pretty sure that most are aware, but it's in the engine notes anyway. :thumbup:
othoma
Posts: 6
Joined: Sun Dec 11, 2016 8:32 am
Sign-up code: 10159

Re: The latest CCRL update (23rd December 2023)

Post by othoma »

I am sorry, everybody knows official Fritz, not Ginko , so everybody is searching now Frtiz 19 especially if there is Fritz 18 in CCRL.
User avatar
Graham Banks
Posts: 27536
Joined: Sun Dec 18, 2005 5:47 pm
Sign-up code: 0
Location: Auckland, NZ

Re: The latest CCRL update (17th August 2024)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics (17th August) are available for viewing from the following links:

www.computerchess.org.uk/ccrl/4040 (40/15 and 15m+10s)
www.computerchess.org.uk/ccrl/404 (BLITZ 2m+1s)
www.computerchess.org.uk/ccrl/402.archive/ (BLITZ 40/2 Archive)
www.computerchess.org.uk/ccrl/404FRC (FRC 40/2)

Our 40 moves in 15 minutes repeating (including 15 minutes with 10 second increments) and 2 minutes with 1 second increments are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.
All of our current testing uses AVX2 compiles where available.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.

It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to:
- all of our currently active testers (Graham, Gabor, Basti, and Shaun).
- Ray who ran the time-consuming weekly updates for a very long time, a task that has been taken over for now by Basti.
- Jay Honnold for both the tournament viewer and for hosting Graham's live broadcasts.
- all engine authors.
- Anton Mihailov (Chessdom.com) who graciously hosted our website for a long period of time.

40/15 and 15m+10s testing this week will include (Thanks to Graham. Live broadcast given where applicable):

Live broadcasts of some Gauntlets can be made available upon request.
(Web based viewer courtesy of Jay Honnold, with additions by Lana (Princhess), Jost Triller (Nalwald) and Finn Eggers (Koivisto).

111th Amateur Series Division 1 Tournament (finishing Wednesday) Web based viewer http://ccrl.live/16071
111th Amateur Series Division 2 Tournament (finishing Wednesday) Web based viewer http://ccrl.live/16068
111th Amateur Series Division 3 Tournament (finishing Thursday) Web based viewer http://ccrl.live/16066
111th Amateur Series Division 4 Tournament (starting Wednesday) Viewing link to be advised
111th Amateur Series Division 5 Tournament (starting Wednesday) Viewing link to be advised
111th Amateur Series Division 6 Tournament (starting Thursday) Viewing link to be advised
Towards The Bright Light Tournament (finishing Tuesday) Web based viewer http://ccrl.live/16067
New Tournament (starting Tuesday) Viewing link to be advised

Rubichess 20240817 64-bit 4CPU Gauntlet (continuing) Web based viewer http://ccrl.live/16061
Plentychess 2.1.0 64-bit 4CPU Gauntlet (finishing Wednesday) Web based viewer http://ccrl.live/16062
Caissa 1.20 64-bit 4CPU Gauntlet (finishing Friday) Web based viewer http://ccrl.live/16063
Viridithas 14.0.1 64-bit 4CPU Gauntlet (starting Wednesday) Web based viewer http://ccrl.live/16062
Clover 7.0 64-bit 4CPU Gauntlet (starting Friday) Web based viewer http://ccrl.live/16063

Lizard 10.5 64-bit Gauntlet (continuing)
Plentychess 2.1.0 64-bit Gauntlet (continuing)
Caissa 1.20 64-bit Gauntlet (continuing)
Clover 7.0 64-bit Gauntlet (continuing)
Spaghet BologNNese 1.0 64-bit Gauntlet (continuing)

2m+1s testing since the last update report has included (thanks to Gabor):

Ronja 0.8.2 64-bit
Javelin 3.0.0 64-bit
Simbelmyne 1.9.0 64-bit
Dirty Duna 64-bit
Radiance 3.1.1 64-bit
Illumina 1.0 64-bit
Inanis 1.4.0 64-bit

FRC 40/2 testing since the last update report has included (thanks to Basti):[/b]

Heimdall 0.4 64-bit (completed)
Halogen 12 64-bit (completed)
Velvet 8.0.0 64-bit (in progress)
Viridithas 14.0.1 64-bit (in progress)
Rubichess 20240817 64-bit (in progress)

A new list for Chess324 is being started by Basti.
Post Reply